Jul 29 14:59:41.194012 ip-10-0-135-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 14:59:41.194028 ip-10-0-135-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 14:59:41.194040 ip-10-0-135-6 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 14:59:41.194388 ip-10-0-135-6 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 14:59:51.194934 ip-10-0-135-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 14:59:51.194954 ip-10-0-135-6 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 275eb06192f440d29a4d447fa1469803 -- Jul 29 15:01:43.432703 ip-10-0-135-6 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:01:43.788886 ip-10-0-135-6 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:43.788886 ip-10-0-135-6 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:01:43.788886 ip-10-0-135-6 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:43.788886 ip-10-0-135-6 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:01:43.788886 ip-10-0-135-6 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:43.789655 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.789515 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:01:43.793537 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793520 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793538 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793543 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793546 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793549 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793553 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793556 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793559 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793562 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793566 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793570 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793573 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793576 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793579 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793582 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.793579 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793585 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793588 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793591 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793594 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793597 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793599 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793602 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793605 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793607 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793610 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793612 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793615 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793617 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793620 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793622 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793625 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793628 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793631 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793633 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793636 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.793959 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793638 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793641 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793643 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793645 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793648 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793650 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793653 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793656 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793659 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793661 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793664 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793668 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793671 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793673 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793676 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793679 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793682 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793685 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793687 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793690 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.794441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793692 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793695 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793697 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793700 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793702 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793705 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793707 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793710 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793712 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793715 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793717 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793732 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793735 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793738 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793741 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793743 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793746 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793750 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793753 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793756 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.794951 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793758 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793761 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793763 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793768 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793776 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793779 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793782 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793785 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793787 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793790 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793793 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793795 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793798 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793802 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793805 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793808 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793811 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793814 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.795470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793816 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793819 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793822 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793824 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793827 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.793830 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794585 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794592 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794595 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794598 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794601 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794603 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794606 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794608 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794611 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794614 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794616 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794619 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794622 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794626 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.795929 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794629 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794631 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794634 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794637 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794639 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794642 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794644 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794647 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794651 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794655 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794658 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794661 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794665 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794668 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794671 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794673 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794676 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794679 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794682 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.796422 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794684 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794687 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794689 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794692 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794696 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794699 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794702 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794705 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794708 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794711 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794715 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794718 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794736 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794740 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794743 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794745 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794748 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794751 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794754 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.796902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794756 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794759 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794762 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794765 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794768 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794770 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794773 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794775 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794778 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794780 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794783 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794786 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794789 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794791 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794794 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794796 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794799 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794802 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794805 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794807 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.797372 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794810 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794813 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794815 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794818 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794821 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794824 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794826 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794829 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794832 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794835 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794837 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794840 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794842 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794844 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794847 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794850 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794852 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794855 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794857 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794860 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.797877 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794862 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794865 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794868 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794870 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794873 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794876 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.794878 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795251 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795256 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795259 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795262 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795264 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795267 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795270 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795273 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795276 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795279 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795281 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795284 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795294 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.798387 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795297 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795299 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795302 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795304 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795307 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795309 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795312 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795316 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795320 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795323 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795326 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795328 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795331 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795333 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795339 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795341 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795344 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795347 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795350 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.798902 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795352 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795355 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795357 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795360 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795363 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795365 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795368 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795371 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795374 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795376 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795379 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795381 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795384 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795387 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795389 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795392 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795395 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795398 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795400 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795403 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.799357 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795405 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795408 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795410 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795413 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795415 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795418 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795420 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795424 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795426 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795430 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795434 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795436 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795439 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795442 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795445 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795447 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795451 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795454 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795456 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795459 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.799859 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795462 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795464 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795466 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795469 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795471 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795474 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795477 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795480 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795483 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795503 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795506 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795509 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795512 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795515 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795518 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795521 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795523 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795526 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795529 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795534 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.800495 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795536 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795539 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795541 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795544 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795548 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795552 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.795554 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795627 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795638 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795647 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795654 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795660 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795665 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795671 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795678 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795682 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795685 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795688 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795692 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795696 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795699 2583 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795702 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:01:43.801012 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795705 2583 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795708 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795711 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795715 2583 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795718 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795733 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795736 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795740 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795744 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795749 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795752 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795755 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795759 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795762 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795765 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795768 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795771 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795776 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795780 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795783 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795786 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795789 2583 flags.go:64] FLAG: --enable-server="true" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795792 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795797 2583 flags.go:64] FLAG: --event-burst="100" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795800 2583 flags.go:64] FLAG: --event-qps="50" Jul 29 15:01:43.801559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795803 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795806 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795809 2583 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795814 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795817 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795821 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795824 2583 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795827 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795830 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795833 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795836 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795839 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795842 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795844 2583 flags.go:64] FLAG: --feature-gates="" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795848 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795851 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795856 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795859 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795862 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795865 2583 flags.go:64] FLAG: --help="false" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795868 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-135-6.ec2.internal" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795871 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795874 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:01:43.802202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795877 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795881 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795887 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795890 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795893 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795896 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795899 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795902 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795905 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795908 2583 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795911 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795914 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795917 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795920 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795923 2583 flags.go:64] FLAG: --lock-file="" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795926 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795929 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795932 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795938 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795941 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795944 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795948 2583 flags.go:64] FLAG: --logging-format="text" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795950 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795954 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:01:43.802786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795957 2583 flags.go:64] FLAG: --manifest-url="" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795960 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795965 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795968 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795972 2583 flags.go:64] FLAG: --max-pods="110" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795975 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795979 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795982 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795985 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795988 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795993 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.795996 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796004 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796007 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796010 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796013 2583 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796016 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796021 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796024 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796027 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796030 2583 flags.go:64] FLAG: --port="10250" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796033 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796036 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00cffd82eb8a8fdcc" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796040 2583 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:01:43.803373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796043 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796046 2583 flags.go:64] FLAG: --register-node="true" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796049 2583 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796053 2583 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796056 2583 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796059 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796062 2583 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796065 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796068 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796072 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796075 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796077 2583 flags.go:64] FLAG: --runonce="false" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796080 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796083 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796087 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796089 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796093 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796096 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796099 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796103 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796106 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796109 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796112 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796115 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796118 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:01:43.804036 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796121 2583 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796124 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796129 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796132 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796135 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796139 2583 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796142 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796145 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796148 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796151 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796154 2583 flags.go:64] FLAG: --v="2" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796158 2583 flags.go:64] FLAG: --version="false" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796162 2583 flags.go:64] FLAG: --vmodule="" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796166 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.796170 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796309 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796314 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796317 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796320 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796323 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796326 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796328 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796331 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.804647 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796334 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796337 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796340 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796345 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796348 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796351 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796353 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796356 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796359 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796361 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796364 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796367 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796370 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796373 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796375 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796378 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796381 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796383 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796386 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796389 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.805229 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796392 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796395 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796397 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796400 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796402 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796406 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796410 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796413 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796415 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796418 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796421 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796423 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796426 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796429 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796432 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796435 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796438 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796441 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796444 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.805744 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796446 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796449 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796452 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796456 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796459 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796461 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796464 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796467 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796469 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796472 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796475 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796478 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796481 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796483 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796486 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796490 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796494 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796497 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796500 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.806224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796503 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796505 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796508 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796510 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796513 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796515 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796518 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796521 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796523 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796527 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796530 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796533 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796535 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796538 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796540 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796543 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796547 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796550 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796552 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796555 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796557 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.806693 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796560 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796563 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796565 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796568 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796570 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796574 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796577 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796580 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796584 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796587 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796590 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.796592 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.797087 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.803341 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.803356 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:01:43.807228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.803375 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.803384 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803441 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803446 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803450 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803453 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803455 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803458 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803461 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803463 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803466 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803469 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803471 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803474 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803477 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803479 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803482 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803484 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803487 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803489 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.807604 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803492 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803495 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803497 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803500 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803502 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803506 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803508 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803511 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803514 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803516 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803519 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803524 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803526 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803529 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803532 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803534 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803536 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803539 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803542 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803545 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.808115 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803547 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803550 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803553 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803555 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803558 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803560 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803562 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803565 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803568 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803570 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803573 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803576 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803579 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803581 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803584 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803586 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803589 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803591 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803593 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803596 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.808596 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803599 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803601 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803604 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803608 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803612 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803616 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803619 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803622 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803625 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803627 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803630 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803633 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803635 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803640 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803643 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803646 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803649 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803652 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803654 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.809086 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803657 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803659 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803662 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803665 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803668 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803670 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803673 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803675 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803678 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803680 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803683 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803685 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803688 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803692 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803696 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803699 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803702 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803706 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803709 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.809607 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803712 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803714 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803717 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.803740 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803857 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803862 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803865 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803868 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803871 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803874 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803877 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803880 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803883 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803886 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803889 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803892 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:43.810096 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803895 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803898 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803900 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803903 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803906 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803909 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803911 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803914 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803916 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803919 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803921 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803924 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803927 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803930 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803932 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803935 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803938 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803940 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803943 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803945 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:43.810484 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803948 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803951 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803953 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803956 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803959 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803961 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803964 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803966 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803970 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803973 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803976 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803979 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803982 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803985 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803987 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803990 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803993 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803996 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.803998 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:43.810983 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804001 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804004 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804007 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804009 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804012 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804015 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804018 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804022 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804025 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804028 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804031 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804034 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804037 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804040 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804043 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804046 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804048 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804051 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804054 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:43.811441 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804057 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804059 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804062 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804064 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804067 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804069 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804071 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804075 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804078 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804081 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804084 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804086 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804088 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804091 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804093 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804096 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804099 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804102 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804104 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804107 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:43.811911 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804109 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804112 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804114 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804117 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804120 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804123 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804125 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804128 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:43.804130 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.804136 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.804253 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.806082 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.807158 2583 server.go:1019] "Starting client certificate rotation" Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.807255 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:43.812404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.807981 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:43.812999 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.809622 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:43.812999 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.810749 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:43.822032 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.822012 2583 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:01:43.823970 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.823953 2583 log.go:25] "Validated CRI v1 image API" Jul 29 15:01:43.824716 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.824700 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:01:43.827404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.827378 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae3296c0-466d-40b2-86cb-bfaec7fba16f:/dev/nvme0n1p4 d3ee8bfb-80c1-431e-af50-6e1627b03556:/dev/nvme0n1p3] Jul 29 15:01:43.827460 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.827403 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:01:43.833227 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.833113 2583 manager.go:216] Machine: {Timestamp:2026-07-29 15:01:43.83186662 +0000 UTC m=+0.293357107 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100281 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2360fbb4a2c313fcbc1f82b286ce92 SystemUUID:ec2360fb-b4a2-c313-fcbc-1f82b286ce92 BootID:275eb061-92f4-40d2-9a4d-447fa1469803 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:65:ac:3e:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:65:ac:3e:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:0a:3f:8e:63:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:01:43.833227 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.833225 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:01:43.833320 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.833308 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:01:43.835176 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.835143 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:01:43.835317 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.835180 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:01:43.836263 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.836250 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:01:43.836303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.836266 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:01:43.836303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.836274 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:43.837400 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.837388 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:43.838096 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.838085 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:01:43.839870 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.839856 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:43.839995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.839986 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:01:43.840024 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840017 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:01:43.840052 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840028 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:01:43.840052 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840041 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:01:43.840052 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840051 2583 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:01:43.840150 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840060 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:01:43.840449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840437 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:43.840489 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.840459 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:43.841530 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.841506 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:43.842662 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.842640 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:01:43.844193 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.844179 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:01:43.844255 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.844210 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:01:43.845760 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845745 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:01:43.845760 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845763 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845769 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845775 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845788 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845797 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845806 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845811 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845818 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845824 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845832 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:01:43.845867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.845838 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:01:43.846477 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.846466 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:01:43.846477 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.846477 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:01:43.849963 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.849948 2583 server.go:1268] "Started kubelet" Jul 29 15:01:43.850071 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.850038 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:01:43.850124 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.850061 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:01:43.850180 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.850143 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:01:43.850947 ip-10-0-135-6 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:01:43.851800 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.851782 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:01:43.854686 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.854635 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:01:43.854686 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.854659 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:01:43.854850 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.854693 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:01:43.855661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.855641 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:01:43.857788 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.857764 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:01:43.860186 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.859310 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad1983a634f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.849919311 +0000 UTC m=+0.311409798,LastTimestamp:2026-07-29 15:01:43.849919311 +0000 UTC m=+0.311409798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.862261 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.862237 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:01:43.862261 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.862253 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:43.862389 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.862372 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:43.862857 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.862838 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:01:43.862985 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.862958 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:01:43.862985 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.862976 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:01:43.863138 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863101 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:01:43.863138 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863108 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:01:43.863259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863243 2583 factory.go:55] Registering systemd factory Jul 29 15:01:43.863308 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863264 2583 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:01:43.863511 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863492 2583 factory.go:153] Registering CRI-O factory Jul 29 15:01:43.863511 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863513 2583 factory.go:223] Registration of the crio container factory successfully Jul 29 15:01:43.863624 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863568 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:01:43.863624 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863594 2583 factory.go:103] Registering Raw factory Jul 29 15:01:43.863624 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.863612 2583 manager.go:1196] Started watching for new ooms in manager Jul 29 15:01:43.864283 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.864267 2583 manager.go:349] Starting recovery of all containers Jul 29 15:01:43.872543 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.872395 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:01:43.872625 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.872553 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:01:43.875071 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.875052 2583 manager.go:354] Recovery completed Jul 29 15:01:43.879129 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.879117 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:43.880938 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.880914 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:43.881017 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.880955 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:43.881017 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.880967 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:43.881519 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.881506 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:01:43.881584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.881519 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:01:43.881584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.881537 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:43.881584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.881572 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:43.882241 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.882228 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:43.882297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.882249 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:43.882297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.882259 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:43.883027 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.883017 2583 policy_none.go:49] "None policy: Start" Jul 29 15:01:43.883067 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.883033 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:01:43.883067 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.883042 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:01:43.884011 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.884001 2583 policy_none.go:47] "Start" Jul 29 15:01:43.890078 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.890002 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a13af45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880937285 +0000 UTC m=+0.342427775,LastTimestamp:2026-07-29 15:01:43.880937285 +0000 UTC m=+0.342427775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.893229 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.893170 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a140aa0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880960672 +0000 UTC m=+0.342451158,LastTimestamp:2026-07-29 15:01:43.880960672 +0000 UTC m=+0.342451158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.900633 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.900563 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a14306b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880970347 +0000 UTC m=+0.342460831,LastTimestamp:2026-07-29 15:01:43.880970347 +0000 UTC m=+0.342460831,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.912395 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.912329 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-6.ec2.internal.18c6cad19a13af45\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a13af45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880937285 +0000 UTC m=+0.342427775,LastTimestamp:2026-07-29 15:01:43.882239373 +0000 UTC m=+0.343729857,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.923217 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923202 2583 manager.go:337] "Starting Device Plugin manager" Jul 29 15:01:43.923300 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.923235 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:01:43.923300 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923245 2583 server.go:87] "Starting device plugin registration server" Jul 29 15:01:43.923471 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923460 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:01:43.923528 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923481 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:01:43.923603 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923588 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:01:43.923699 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923659 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:01:43.923699 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.923669 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:01:43.924152 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.924128 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:01:43.924239 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.924179 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:43.929616 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.929541 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-6.ec2.internal.18c6cad19a140aa0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a140aa0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880960672 +0000 UTC m=+0.342451158,LastTimestamp:2026-07-29 15:01:43.882254102 +0000 UTC m=+0.343744587,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.937126 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.937057 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-6.ec2.internal.18c6cad19a14306b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19a14306b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-6.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.880970347 +0000 UTC m=+0.342460831,LastTimestamp:2026-07-29 15:01:43.882262831 +0000 UTC m=+0.343753315,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.945849 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.945778 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-6.ec2.internal.18c6cad19d5ec591 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-6.ec2.internal,UID:ip-10-0-135-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-6.ec2.internal,},FirstTimestamp:2026-07-29 15:01:43.936189841 +0000 UTC m=+0.397680312,LastTimestamp:2026-07-29 15:01:43.936189841 +0000 UTC m=+0.397680312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-6.ec2.internal,}" Jul 29 15:01:43.966409 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.966388 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qdscg" Jul 29 15:01:43.968916 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.966450 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:01:43.968916 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.967484 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:01:43.968916 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.967532 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:01:43.968916 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.967560 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:01:43.968916 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.967602 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:01:43.976268 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:43.976236 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 29 15:01:43.979995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:43.979977 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qdscg" Jul 29 15:01:44.024627 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.024600 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.025541 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.025528 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.025608 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.025556 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.025608 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.025565 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.025608 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.025589 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.042935 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.042877 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.042935 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.042909 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-6.ec2.internal\": node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.067772 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.067748 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal"] Jul 29 15:01:44.067907 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.067811 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.069228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.069212 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.069320 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.069239 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.069320 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.069248 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.070429 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.070417 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.070553 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.070526 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.070658 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.070562 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.071177 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071162 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.071259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071191 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.071259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071200 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.071259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071163 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.071259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071256 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.071366 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.071269 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.072256 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.072242 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.072302 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.072266 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.072958 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.072941 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.073024 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.072967 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.073024 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.072978 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.081692 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.081676 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.095601 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.095576 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-6.ec2.internal\" not found" node="ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.099711 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.099695 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-6.ec2.internal\" not found" node="ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.165213 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.165182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.165213 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.165213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.165365 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.165230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a451fcd7dba34c111ce1bc770c865cd5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-6.ec2.internal\" (UID: \"a451fcd7dba34c111ce1bc770c865cd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.182301 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.182274 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.266145 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.266235 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.266235 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a451fcd7dba34c111ce1bc770c865cd5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-6.ec2.internal\" (UID: \"a451fcd7dba34c111ce1bc770c865cd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.266235 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.266235 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266228 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a451fcd7dba34c111ce1bc770c865cd5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-6.ec2.internal\" (UID: \"a451fcd7dba34c111ce1bc770c865cd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.266352 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.266208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10eeb41e26f8439ae2048b37f0fdde32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal\" (UID: \"10eeb41e26f8439ae2048b37f0fdde32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.283184 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.283158 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.383895 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.383819 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.397953 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.397929 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.402625 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.402607 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:44.484637 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.484601 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.585110 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.585072 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.685552 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.685478 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.785950 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.785914 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.807091 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.807067 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:01:44.886907 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.886863 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:44.984249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.984196 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 14:56:43 +0000 UTC" deadline="2028-01-22 04:31:53.861546003 +0000 UTC" Jul 29 15:01:44.984249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:44.984242 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12997h30m8.877309768s" Jul 29 15:01:44.987355 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:44.987332 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:45.022664 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.022631 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:45.024651 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.024634 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:45.024779 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.024666 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:45.024779 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.024676 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:45.038073 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:45.038028 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10eeb41e26f8439ae2048b37f0fdde32.slice/crio-2703904d18a2bc4817bacac4720d0bc83af76f0192cddc411934ec8bb7ae68d8 WatchSource:0}: Error finding container 2703904d18a2bc4817bacac4720d0bc83af76f0192cddc411934ec8bb7ae68d8: Status 404 returned error can't find the container with id 2703904d18a2bc4817bacac4720d0bc83af76f0192cddc411934ec8bb7ae68d8 Jul 29 15:01:45.042132 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.042114 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:01:45.088508 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.088454 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-6.ec2.internal\" not found" Jul 29 15:01:45.155852 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.155826 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.163021 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.162997 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" Jul 29 15:01:45.175896 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.175873 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.177203 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.177186 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" Jul 29 15:01:45.189360 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.189328 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.189473 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.189392 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.355768 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.355719 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.377948 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.377922 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.736718 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:45.736697 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda451fcd7dba34c111ce1bc770c865cd5.slice/crio-d1489df3b918189b7f0b43cf7ece41b048875a68773ddd42ffa1286603d8e8a5 WatchSource:0}: Error finding container d1489df3b918189b7f0b43cf7ece41b048875a68773ddd42ffa1286603d8e8a5: Status 404 returned error can't find the container with id d1489df3b918189b7f0b43cf7ece41b048875a68773ddd42ffa1286603d8e8a5 Jul 29 15:01:45.840543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.840499 2583 apiserver.go:52] "Watching apiserver" Jul 29 15:01:45.847995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.847968 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:01:45.848797 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.848775 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-g4df6","openshift-multus/network-metrics-daemon-ks9kp","openshift-network-diagnostics/network-check-target-xcfdp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx","openshift-cluster-node-tuning-operator/tuned-skv67","openshift-dns/node-resolver-d24pq","openshift-multus/multus-zqfgt","openshift-network-operator/iptables-alerter-8k6gx","openshift-ovn-kubernetes/ovnkube-node-fknlj","kube-system/global-pull-secret-syncer-jjwrx","kube-system/konnectivity-agent-qvvrs","kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal","openshift-image-registry/node-ca-v6t5n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal"] Jul 29 15:01:45.850175 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.850161 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.851249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.851230 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:45.851374 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.851297 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:45.852324 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.852308 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.853386 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.853368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.854454 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.854434 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.855608 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.855584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.855792 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.855725 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:01:45.855880 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.855793 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.856421 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.856401 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kxvqd\"" Jul 29 15:01:45.856888 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.856867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:45.856984 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.856966 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:45.857049 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.856997 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.857088 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.857063 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:01:45.857144 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.857062 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:01:45.857419 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.857402 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.858043 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.858023 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.858151 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.858043 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:01:45.858374 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.858267 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nsg2l\"" Jul 29 15:01:45.858463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.858393 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:01:45.858521 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.858506 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-msfp4\"" Jul 29 15:01:45.859579 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.859560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.859771 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.859751 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.860708 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.860694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.860793 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.860771 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:45.861956 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.861939 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.862309 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.862293 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.862392 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.862344 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.863020 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.863000 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:45.863275 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.863253 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.867041 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867023 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bzgl5\"" Jul 29 15:01:45.867133 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867065 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x5c2m\"" Jul 29 15:01:45.867299 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867259 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.867385 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867332 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.867385 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867345 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.867509 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867493 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.867570 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867545 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.867627 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867587 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:01:45.867627 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867609 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.867854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867840 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.867932 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.867892 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-82jkf\"" Jul 29 15:01:45.868138 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868120 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:01:45.868197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868145 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g7bzn\"" Jul 29 15:01:45.868197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868151 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:01:45.868307 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868221 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:01:45.868307 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868276 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:01:45.868307 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868299 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xblbp\"" Jul 29 15:01:45.868307 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868303 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h49vg\"" Jul 29 15:01:45.868497 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868328 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.868497 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.868328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:01:45.869811 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.869794 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:01:45.870009 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.869994 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:01:45.875354 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-script-lib\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.875449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddd5073b-4652-4ce0-ae7f-ff0d32952135-host\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.875449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875397 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-hostroot\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.875449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6t4v\" (UniqueName: \"kubernetes.io/projected/fee60bb3-da92-4fef-8f8c-157442bac820-kube-api-access-w6t4v\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.875449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-ovn\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-tmp-dir\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875488 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-system-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-system-cni-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8942n\" (UniqueName: \"kubernetes.io/projected/86599312-b29d-4a37-a0c4-4bba97dabae3-kube-api-access-8942n\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73879b34-8cbc-4439-91c4-ccef773610ba-agent-certs\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.875630 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f94f9\" (UniqueName: \"kubernetes.io/projected/ca630015-a15c-489c-80ee-a47d191755af-kube-api-access-f94f9\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfzb\" (UniqueName: \"kubernetes.io/projected/f2710b3e-61bb-486a-9777-3fdbff4b5913-kube-api-access-5gfzb\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875665 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875692 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-k8s-cni-cncf-io\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875717 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-etc-kubernetes\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-lib-modules\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875833 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fee60bb3-da92-4fef-8f8c-157442bac820-host-slash\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-log-socket\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.875881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875879 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-config\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-env-overrides\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-socket-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-systemd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.875991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tl4x\" (UniqueName: \"kubernetes.io/projected/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-kube-api-access-5tl4x\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vscv\" (UniqueName: \"kubernetes.io/projected/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-kube-api-access-5vscv\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-kubelet\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-cnibin\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876102 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysconfig\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-kubelet\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-node-log\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-bin\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876234 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-systemd-units\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876255 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-host\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-tuned\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-dbus\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876312 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876329 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876365 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-kubernetes\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876380 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-run\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876392 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-slash\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876427 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqqts\" (UniqueName: \"kubernetes.io/projected/3548b7b6-2bde-4aff-ba4e-426360667b84-kube-api-access-zqqts\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6pqq\" (UniqueName: \"kubernetes.io/projected/ddd5073b-4652-4ce0-ae7f-ff0d32952135-kube-api-access-c6pqq\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98gl\" (UniqueName: \"kubernetes.io/projected/28acc0d0-5408-41bb-a60b-e29bf780d9c2-kube-api-access-n98gl\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876547 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-netns\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.876747 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3548b7b6-2bde-4aff-ba4e-426360667b84-ovn-node-metrics-cert\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddd5073b-4652-4ce0-ae7f-ff0d32952135-serviceca\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-cnibin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876656 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-os-release\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-bin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876718 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876768 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fee60bb3-da92-4fef-8f8c-157442bac820-iptables-alerter-script\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876813 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-multus-daemon-config\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-multus-certs\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-os-release\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876886 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-sys\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876908 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73879b34-8cbc-4439-91c4-ccef773610ba-konnectivity-ca\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876928 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-cni-binary-copy\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.877197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.876975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877007 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-conf\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-multus\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-sys-fs\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877104 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-modprobe-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-var-lib-kubelet\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-tmp\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877180 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-kubelet-config\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877219 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-netns\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-registration-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877250 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-device-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877272 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-systemd\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-etc-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877312 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-hosts-file\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.877863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-socket-dir-parent\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.878304 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-conf-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.878304 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-var-lib-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.878304 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.878304 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.877524 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-netd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.901737 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.901704 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:45.963704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.963675 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:01:45.974246 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.974189 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" event={"ID":"a451fcd7dba34c111ce1bc770c865cd5","Type":"ContainerStarted","Data":"d1489df3b918189b7f0b43cf7ece41b048875a68773ddd42ffa1286603d8e8a5"} Jul 29 15:01:45.975227 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.975204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" event={"ID":"10eeb41e26f8439ae2048b37f0fdde32","Type":"ContainerStarted","Data":"2703904d18a2bc4817bacac4720d0bc83af76f0192cddc411934ec8bb7ae68d8"} Jul 29 15:01:45.978441 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73879b34-8cbc-4439-91c4-ccef773610ba-agent-certs\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.978538 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978448 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f94f9\" (UniqueName: \"kubernetes.io/projected/ca630015-a15c-489c-80ee-a47d191755af-kube-api-access-f94f9\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.978538 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978465 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfzb\" (UniqueName: \"kubernetes.io/projected/f2710b3e-61bb-486a-9777-3fdbff4b5913-kube-api-access-5gfzb\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.978538 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:45.978538 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-k8s-cni-cncf-io\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.978743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978558 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-k8s-cni-cncf-io\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.978743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-etc-kubernetes\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.978743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-lib-modules\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.978743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fee60bb3-da92-4fef-8f8c-157442bac820-host-slash\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-log-socket\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-config\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978775 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-etc-kubernetes\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978793 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-env-overrides\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978808 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fee60bb3-da92-4fef-8f8c-157442bac820-host-slash\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-socket-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978833 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-log-socket\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-systemd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tl4x\" (UniqueName: \"kubernetes.io/projected/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-kube-api-access-5tl4x\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:45.978933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978917 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-systemd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vscv\" (UniqueName: \"kubernetes.io/projected/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-kube-api-access-5vscv\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978947 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-socket-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-kubelet\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-cnibin\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysconfig\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.979053 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-kubelet\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979091 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-node-log\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979098 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-cnibin\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-bin\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978955 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-lib-modules\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.979153 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.479121266 +0000 UTC m=+2.940611754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979178 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysconfig\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.978942 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-kubelet\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979248 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-kubelet\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979258 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-node-log\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.979436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979284 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-systemd-units\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979293 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-bin\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979323 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-host\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979336 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-systemd-units\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979352 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-env-overrides\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979376 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-tuned\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979402 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-host\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979421 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-config\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-dbus\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979523 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-kubernetes\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-run\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-dbus\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-slash\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979739 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-kubernetes\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqqts\" (UniqueName: \"kubernetes.io/projected/3548b7b6-2bde-4aff-ba4e-426360667b84-kube-api-access-zqqts\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-etc-selinux\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.980240 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-slash\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979805 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-run\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.979844 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6pqq\" (UniqueName: \"kubernetes.io/projected/ddd5073b-4652-4ce0-ae7f-ff0d32952135-kube-api-access-c6pqq\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:45.979890 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.47987038 +0000 UTC m=+2.941360866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979915 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98gl\" (UniqueName: \"kubernetes.io/projected/28acc0d0-5408-41bb-a60b-e29bf780d9c2-kube-api-access-n98gl\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.979987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-netns\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3548b7b6-2bde-4aff-ba4e-426360667b84-ovn-node-metrics-cert\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddd5073b-4652-4ce0-ae7f-ff0d32952135-serviceca\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980039 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-netns\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-cnibin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980120 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-os-release\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-bin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980197 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fee60bb3-da92-4fef-8f8c-157442bac820-iptables-alerter-script\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-multus-daemon-config\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980286 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-bin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-multus-certs\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980327 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-os-release\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980342 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-cnibin\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-sys\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73879b34-8cbc-4439-91c4-ccef773610ba-konnectivity-ca\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980400 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-os-release\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-cni-binary-copy\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980457 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddd5073b-4652-4ce0-ae7f-ff0d32952135-serviceca\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-multus-certs\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-os-release\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.981961 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-conf\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-multus\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-sys-fs\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-modprobe-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980763 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-var-lib-kubelet\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-tmp\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980858 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-kubelet-config\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-netns\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980946 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-sys\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981006 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-multus-daemon-config\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981006 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-registration-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981045 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981050 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca630015-a15c-489c-80ee-a47d191755af-cni-binary-copy\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.980947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-registration-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.982791 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981083 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-device-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981121 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-systemd\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-etc-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981186 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-hosts-file\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-socket-dir-parent\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981222 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fee60bb3-da92-4fef-8f8c-157442bac820-iptables-alerter-script\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-conf-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981265 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-var-lib-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981293 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-modprobe-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-var-lib-cni-multus\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981360 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-device-dir\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-conf\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981403 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-netd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2710b3e-61bb-486a-9777-3fdbff4b5913-sys-fs\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.983340 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981426 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-hosts-file\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981454 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-systemd\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981471 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-socket-dir-parent\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981486 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981515 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-multus-conf-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-sysctl-d\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981549 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73879b34-8cbc-4439-91c4-ccef773610ba-konnectivity-ca\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981576 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-etc-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-var-lib-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981593 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4f0425b-802f-4b3a-b2eb-a7747778dfde-kubelet-config\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981642 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-openvswitch\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981543 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28acc0d0-5408-41bb-a60b-e29bf780d9c2-var-lib-kubelet\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981649 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-host-run-netns\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-host-cni-netd\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-script-lib\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddd5073b-4652-4ce0-ae7f-ff0d32952135-host\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-hostroot\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.983821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6t4v\" (UniqueName: \"kubernetes.io/projected/fee60bb3-da92-4fef-8f8c-157442bac820-kube-api-access-w6t4v\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-ovn\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981885 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-tmp-dir\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-system-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981924 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86599312-b29d-4a37-a0c4-4bba97dabae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981990 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-hostroot\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981930 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-system-cni-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982029 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddd5073b-4652-4ce0-ae7f-ff0d32952135-host\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8942n\" (UniqueName: \"kubernetes.io/projected/86599312-b29d-4a37-a0c4-4bba97dabae3-kube-api-access-8942n\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982203 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3548b7b6-2bde-4aff-ba4e-426360667b84-ovnkube-script-lib\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca630015-a15c-489c-80ee-a47d191755af-system-cni-dir\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.981991 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86599312-b29d-4a37-a0c4-4bba97dabae3-system-cni-dir\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982363 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3548b7b6-2bde-4aff-ba4e-426360667b84-run-ovn\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982474 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-tmp-dir\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-etc-tuned\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.982924 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3548b7b6-2bde-4aff-ba4e-426360667b84-ovn-node-metrics-cert\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.983216 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73879b34-8cbc-4439-91c4-ccef773610ba-agent-certs\") pod \"konnectivity-agent-qvvrs\" (UID: \"73879b34-8cbc-4439-91c4-ccef773610ba\") " pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:45.984297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.983693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28acc0d0-5408-41bb-a60b-e29bf780d9c2-tmp\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:45.998249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.998184 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfzb\" (UniqueName: \"kubernetes.io/projected/f2710b3e-61bb-486a-9777-3fdbff4b5913-kube-api-access-5gfzb\") pod \"aws-ebs-csi-driver-node-pllhx\" (UID: \"f2710b3e-61bb-486a-9777-3fdbff4b5913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:45.998372 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.998298 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f94f9\" (UniqueName: \"kubernetes.io/projected/ca630015-a15c-489c-80ee-a47d191755af-kube-api-access-f94f9\") pod \"multus-zqfgt\" (UID: \"ca630015-a15c-489c-80ee-a47d191755af\") " pod="openshift-multus/multus-zqfgt" Jul 29 15:01:45.998424 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:45.998381 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tl4x\" (UniqueName: \"kubernetes.io/projected/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-kube-api-access-5tl4x\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:46.000787 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.000770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98gl\" (UniqueName: \"kubernetes.io/projected/28acc0d0-5408-41bb-a60b-e29bf780d9c2-kube-api-access-n98gl\") pod \"tuned-skv67\" (UID: \"28acc0d0-5408-41bb-a60b-e29bf780d9c2\") " pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:46.003737 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.003699 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:46.003737 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.003719 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:46.003893 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.003745 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.003893 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.003799 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.503781406 +0000 UTC m=+2.965271880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.004292 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.004276 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6pqq\" (UniqueName: \"kubernetes.io/projected/ddd5073b-4652-4ce0-ae7f-ff0d32952135-kube-api-access-c6pqq\") pod \"node-ca-v6t5n\" (UID: \"ddd5073b-4652-4ce0-ae7f-ff0d32952135\") " pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:46.007005 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.006977 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-drx6q" Jul 29 15:01:46.008202 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.008184 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vscv\" (UniqueName: \"kubernetes.io/projected/dbda1a84-932c-4c2d-8dfb-7eee5f080dbf-kube-api-access-5vscv\") pod \"node-resolver-d24pq\" (UID: \"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf\") " pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:46.008479 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.008463 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8942n\" (UniqueName: \"kubernetes.io/projected/86599312-b29d-4a37-a0c4-4bba97dabae3-kube-api-access-8942n\") pod \"multus-additional-cni-plugins-g4df6\" (UID: \"86599312-b29d-4a37-a0c4-4bba97dabae3\") " pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:46.008537 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.008528 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqqts\" (UniqueName: \"kubernetes.io/projected/3548b7b6-2bde-4aff-ba4e-426360667b84-kube-api-access-zqqts\") pod \"ovnkube-node-fknlj\" (UID: \"3548b7b6-2bde-4aff-ba4e-426360667b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:46.008816 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.008796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6t4v\" (UniqueName: \"kubernetes.io/projected/fee60bb3-da92-4fef-8f8c-157442bac820-kube-api-access-w6t4v\") pod \"iptables-alerter-8k6gx\" (UID: \"fee60bb3-da92-4fef-8f8c-157442bac820\") " pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:46.015955 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.015938 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-drx6q" Jul 29 15:01:46.159519 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.159476 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqfgt" Jul 29 15:01:46.166586 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.166553 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g4df6" Jul 29 15:01:46.175275 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.175250 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" Jul 29 15:01:46.175606 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.175583 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86599312_b29d_4a37_a0c4_4bba97dabae3.slice/crio-777f18101f543ed2103eb4dc1b28cd116b2466cb96f407452a151a1b2b1adf1a WatchSource:0}: Error finding container 777f18101f543ed2103eb4dc1b28cd116b2466cb96f407452a151a1b2b1adf1a: Status 404 returned error can't find the container with id 777f18101f543ed2103eb4dc1b28cd116b2466cb96f407452a151a1b2b1adf1a Jul 29 15:01:46.179286 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.179264 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-skv67" Jul 29 15:01:46.184598 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.184580 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d24pq" Jul 29 15:01:46.185108 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.185087 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2710b3e_61bb_486a_9777_3fdbff4b5913.slice/crio-30c55061f0c3f19bc25e716048f8c790af34d4a96cb7b891644a433b60015fe3 WatchSource:0}: Error finding container 30c55061f0c3f19bc25e716048f8c790af34d4a96cb7b891644a433b60015fe3: Status 404 returned error can't find the container with id 30c55061f0c3f19bc25e716048f8c790af34d4a96cb7b891644a433b60015fe3 Jul 29 15:01:46.187173 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.187150 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28acc0d0_5408_41bb_a60b_e29bf780d9c2.slice/crio-1911cc22e89bfba3a7987e40b6f8e78111db169c11d45fc01ebc8a37ee274a81 WatchSource:0}: Error finding container 1911cc22e89bfba3a7987e40b6f8e78111db169c11d45fc01ebc8a37ee274a81: Status 404 returned error can't find the container with id 1911cc22e89bfba3a7987e40b6f8e78111db169c11d45fc01ebc8a37ee274a81 Jul 29 15:01:46.190147 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.190001 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k6gx" Jul 29 15:01:46.193224 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.193199 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbda1a84_932c_4c2d_8dfb_7eee5f080dbf.slice/crio-b71bafef9156b2664859bb3c8545371c6b696637067fbb8b699dd56487713f54 WatchSource:0}: Error finding container b71bafef9156b2664859bb3c8545371c6b696637067fbb8b699dd56487713f54: Status 404 returned error can't find the container with id b71bafef9156b2664859bb3c8545371c6b696637067fbb8b699dd56487713f54 Jul 29 15:01:46.196289 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.196269 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:01:46.199957 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.199931 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee60bb3_da92_4fef_8f8c_157442bac820.slice/crio-bfec6e5b1b05721739fb893fc50dc4f67bdf3779b9e44388bb76f936d3e4e1bd WatchSource:0}: Error finding container bfec6e5b1b05721739fb893fc50dc4f67bdf3779b9e44388bb76f936d3e4e1bd: Status 404 returned error can't find the container with id bfec6e5b1b05721739fb893fc50dc4f67bdf3779b9e44388bb76f936d3e4e1bd Jul 29 15:01:46.200680 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.200659 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:01:46.204144 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.204111 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6t5n" Jul 29 15:01:46.205625 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.205492 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3548b7b6_2bde_4aff_ba4e_426360667b84.slice/crio-b60d62d0e4fa3f2931e5ca400005f3c79aba1b9a127e76dacea4c959ef741623 WatchSource:0}: Error finding container b60d62d0e4fa3f2931e5ca400005f3c79aba1b9a127e76dacea4c959ef741623: Status 404 returned error can't find the container with id b60d62d0e4fa3f2931e5ca400005f3c79aba1b9a127e76dacea4c959ef741623 Jul 29 15:01:46.211219 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.211195 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73879b34_8cbc_4439_91c4_ccef773610ba.slice/crio-dfd445a8efca916e24236a16476142e6be00950c663d5dbbfa56219a13cd4e3f WatchSource:0}: Error finding container dfd445a8efca916e24236a16476142e6be00950c663d5dbbfa56219a13cd4e3f: Status 404 returned error can't find the container with id dfd445a8efca916e24236a16476142e6be00950c663d5dbbfa56219a13cd4e3f Jul 29 15:01:46.214037 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:01:46.214012 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd5073b_4652_4ce0_ae7f_ff0d32952135.slice/crio-dc257bdb83d1792f167662ce469f7bb4861f652065fb51d0e1bd7affeadd90ce WatchSource:0}: Error finding container dc257bdb83d1792f167662ce469f7bb4861f652065fb51d0e1bd7affeadd90ce: Status 404 returned error can't find the container with id dc257bdb83d1792f167662ce469f7bb4861f652065fb51d0e1bd7affeadd90ce Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.486296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.486354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.486433 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.486482 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.486515 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.486493423 +0000 UTC m=+3.947983902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.486574 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.486550 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.48653457 +0000 UTC m=+3.948025047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.587137 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.587041 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:46.587293 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.587274 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:46.587347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.587296 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:46.587347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.587310 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.587433 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.587377 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.587357778 +0000 UTC m=+4.048848255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.968647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.968612 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:46.969148 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:46.968793 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:46.978775 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.978709 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-skv67" event={"ID":"28acc0d0-5408-41bb-a60b-e29bf780d9c2","Type":"ContainerStarted","Data":"1911cc22e89bfba3a7987e40b6f8e78111db169c11d45fc01ebc8a37ee274a81"} Jul 29 15:01:46.979999 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.979974 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" event={"ID":"f2710b3e-61bb-486a-9777-3fdbff4b5913","Type":"ContainerStarted","Data":"30c55061f0c3f19bc25e716048f8c790af34d4a96cb7b891644a433b60015fe3"} Jul 29 15:01:46.981513 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.981480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqfgt" event={"ID":"ca630015-a15c-489c-80ee-a47d191755af","Type":"ContainerStarted","Data":"614d6d1730132ca121ea8f6b333608fe2336e2a02411d8c2332a5880f1aa7a82"} Jul 29 15:01:46.982844 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.982818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvvrs" event={"ID":"73879b34-8cbc-4439-91c4-ccef773610ba","Type":"ContainerStarted","Data":"dfd445a8efca916e24236a16476142e6be00950c663d5dbbfa56219a13cd4e3f"} Jul 29 15:01:46.984228 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.984198 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"b60d62d0e4fa3f2931e5ca400005f3c79aba1b9a127e76dacea4c959ef741623"} Jul 29 15:01:46.986068 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.986044 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k6gx" event={"ID":"fee60bb3-da92-4fef-8f8c-157442bac820","Type":"ContainerStarted","Data":"bfec6e5b1b05721739fb893fc50dc4f67bdf3779b9e44388bb76f936d3e4e1bd"} Jul 29 15:01:46.987813 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.987753 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerStarted","Data":"777f18101f543ed2103eb4dc1b28cd116b2466cb96f407452a151a1b2b1adf1a"} Jul 29 15:01:46.990128 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.990094 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6t5n" event={"ID":"ddd5073b-4652-4ce0-ae7f-ff0d32952135","Type":"ContainerStarted","Data":"dc257bdb83d1792f167662ce469f7bb4861f652065fb51d0e1bd7affeadd90ce"} Jul 29 15:01:46.991343 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:46.991319 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d24pq" event={"ID":"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf","Type":"ContainerStarted","Data":"b71bafef9156b2664859bb3c8545371c6b696637067fbb8b699dd56487713f54"} Jul 29 15:01:47.018697 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.018656 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:46 +0000 UTC" deadline="2028-03-21 03:24:40.334103914 +0000 UTC" Jul 29 15:01:47.018697 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.018696 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14412h22m53.315413591s" Jul 29 15:01:47.494956 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.494921 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:47.495161 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.494977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:47.495161 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.495143 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:47.495282 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.495207 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.495188433 +0000 UTC m=+5.956678921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:47.495584 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.495495 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:47.495584 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.495561 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.495545101 +0000 UTC m=+5.957035588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:47.595881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.595830 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:47.596066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.596044 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:47.596066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.596064 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:47.596163 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.596077 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:47.596163 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.596135 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.596116997 +0000 UTC m=+6.057607485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:47.969088 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.968676 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:47.969088 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.969047 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:47.969629 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:47.968673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:47.969629 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:47.969495 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:48.019303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:48.019239 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:46 +0000 UTC" deadline="2028-01-25 22:59:14.842794005 +0000 UTC" Jul 29 15:01:48.019303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:48.019302 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13087h57m26.823496346s" Jul 29 15:01:48.967914 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:48.967885 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:48.968082 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:48.968023 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:49.511492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:49.511592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.511715 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.511802 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.511778344 +0000 UTC m=+9.973268826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.512236 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:49.512347 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.512292 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.512275506 +0000 UTC m=+9.973766004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:49.612149 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:49.612113 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:49.612305 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.612252 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:49.612305 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.612275 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:49.612305 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.612287 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:49.612467 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.612348 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.612327724 +0000 UTC m=+10.073818209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:49.969937 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:49.969906 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:49.970123 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.970044 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:49.970589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:49.970570 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:49.970696 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:49.970676 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:50.968572 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:50.968455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:50.969054 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:50.968600 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:51.968851 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:51.968823 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:51.969295 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:51.968950 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:51.969431 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:51.969411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:51.969597 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:51.969519 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:52.967978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:52.967948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:52.968169 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:52.968098 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:53.543764 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:53.543713 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:53.544236 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:53.543809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:53.544236 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.543859 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:53.544236 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.543897 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:53.544236 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.543936 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.543915226 +0000 UTC m=+18.005405716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:53.544236 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.543958 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.543946637 +0000 UTC m=+18.005437118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:53.649605 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:53.644931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:53.649605 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.646929 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:53.649605 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.646959 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:53.649605 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.646980 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:53.649605 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.647062 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.647036902 +0000 UTC m=+18.108527416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:53.969685 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:53.969605 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:53.969863 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.969716 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:53.970117 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:53.969974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:53.970117 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:53.970082 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:54.968822 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:54.968735 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:54.969282 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:54.968895 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:55.968506 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:55.968199 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:55.968506 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:55.968199 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:55.968506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:55.968340 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:55.968506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:55.968363 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:56.968184 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:56.968156 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:56.968502 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:56.968261 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:57.968521 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:57.968486 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:57.968965 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:57.968486 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:57.968965 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:57.968612 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:57.968965 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:57.968668 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:01:58.968237 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:58.968199 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:01:58.968397 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:58.968340 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:01:59.967962 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:59.967921 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:01:59.967962 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:01:59.967959 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:01:59.968497 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:59.968070 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:01:59.968497 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:01:59.968131 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:00.967949 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:00.967918 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:00.968115 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:00.968036 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:01.607602 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:01.607570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:01.607933 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:01.607614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:01.607933 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.607712 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:01.607933 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.607715 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:01.607933 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.607778 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.607763214 +0000 UTC m=+34.069253687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:01.607933 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.607793 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.607786105 +0000 UTC m=+34.069276579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:01.708877 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:01.708811 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:01.709067 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.708987 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:01.709067 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.709015 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:01.709067 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.709028 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.709177 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.709091 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.709072219 +0000 UTC m=+34.170562716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.968525 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:01.968435 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:01.968985 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:01.968443 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:01.968985 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.968574 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:01.968985 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:01.968653 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:02.968254 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:02.968214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:02.968446 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:02.968360 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:03.968673 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:03.968636 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:03.969156 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:03.968674 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:03.969156 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:03.968762 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:03.969156 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:03.968904 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:04.968198 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:04.968178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:04.968292 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:04.968278 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:05.968219 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:05.967769 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:05.968219 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:05.967808 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:05.968983 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:05.968242 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:05.968983 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:05.968309 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:06.028574 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.028537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" event={"ID":"a451fcd7dba34c111ce1bc770c865cd5","Type":"ContainerStarted","Data":"0a3533702d4a98c451546f67fd6bace456f1d49ffbe7cbeb0620046e05ab23a7"} Jul 29 15:02:06.030066 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.030040 2583 generic.go:356] "Generic (PLEG): container finished" podID="10eeb41e26f8439ae2048b37f0fdde32" containerID="f3f5482bf722e68fe937e6f88e4edfb9c02e0ef635befb6f4da623430372e1ec" exitCode=0 Jul 29 15:02:06.030170 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.030116 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" event={"ID":"10eeb41e26f8439ae2048b37f0fdde32","Type":"ContainerDied","Data":"f3f5482bf722e68fe937e6f88e4edfb9c02e0ef635befb6f4da623430372e1ec"} Jul 29 15:02:06.031582 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.031558 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvvrs" event={"ID":"73879b34-8cbc-4439-91c4-ccef773610ba","Type":"ContainerStarted","Data":"fbc522e95bf082dcd9b3c8901b400d5b8117d6d52206f12506b5b7ddee140159"} Jul 29 15:02:06.034282 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034267 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:02:06.034563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034542 2583 generic.go:356] "Generic (PLEG): container finished" podID="3548b7b6-2bde-4aff-ba4e-426360667b84" containerID="e5bbbfc8af8468d052c335abed9e9f47652ae0dc350b5c8aa1e717bfacca4d29" exitCode=1 Jul 29 15:02:06.034654 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034612 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"bc6091885dce637d525d3ccc306687a46ffe7ef9e2f8d8c623fe148456206965"} Jul 29 15:02:06.034789 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"e4e934bd2701025ebb0ba795704e9462115cf2fd92e86d679cb3795551149849"} Jul 29 15:02:06.034855 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034832 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"5c2d67044e4e5cbc46c1e8c18cf470f14c22a83bc32b7fc10982490aad564fd4"} Jul 29 15:02:06.034893 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"ed8aa1ca21f1cb65325aaf8430d2737632b14535b918f6039dd6369ca6060b62"} Jul 29 15:02:06.034934 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034926 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerDied","Data":"e5bbbfc8af8468d052c335abed9e9f47652ae0dc350b5c8aa1e717bfacca4d29"} Jul 29 15:02:06.034987 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.034974 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"ead7443f01310bd45c64aa05c2897e7fc3127d9a486b6b9403e633f18fce1ab0"} Jul 29 15:02:06.036054 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.036033 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="8bb7587727320271e0bed21b6b1990b053727569d2d5566daa399ccfe2e7542a" exitCode=0 Jul 29 15:02:06.036126 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.036110 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"8bb7587727320271e0bed21b6b1990b053727569d2d5566daa399ccfe2e7542a"} Jul 29 15:02:06.037477 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.037460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6t5n" event={"ID":"ddd5073b-4652-4ce0-ae7f-ff0d32952135","Type":"ContainerStarted","Data":"2501fc14db0bdc5a9a408ad4c5d255e094de9e4f97127962ed5c3981764e373d"} Jul 29 15:02:06.038814 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.038696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d24pq" event={"ID":"dbda1a84-932c-4c2d-8dfb-7eee5f080dbf","Type":"ContainerStarted","Data":"c33641a572420ab0bd30e37f898a31731da04aafbcc79ddca59e57dd462ba236"} Jul 29 15:02:06.040191 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.040172 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-skv67" event={"ID":"28acc0d0-5408-41bb-a60b-e29bf780d9c2","Type":"ContainerStarted","Data":"fcde8432ccbf161915951ef5ece0cdd9f3868e551d0440a76878724287fb1371"} Jul 29 15:02:06.041443 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.041423 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" event={"ID":"f2710b3e-61bb-486a-9777-3fdbff4b5913","Type":"ContainerStarted","Data":"84db41870101695318fb03424258dead23936c652489b27f17e3d587681e4a89"} Jul 29 15:02:06.042698 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.042681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqfgt" event={"ID":"ca630015-a15c-489c-80ee-a47d191755af","Type":"ContainerStarted","Data":"8f75d9fc98fa5e648570f579bf9507df473044a3c636d64c8dd226b256a19e2a"} Jul 29 15:02:06.044022 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.043986 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-6.ec2.internal" podStartSLOduration=21.04397336 podStartE2EDuration="21.04397336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.043285185 +0000 UTC m=+22.504775683" watchObservedRunningTime="2026-07-29 15:02:06.04397336 +0000 UTC m=+22.505463855" Jul 29 15:02:06.061273 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.061229 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qvvrs" podStartSLOduration=3.288058334 podStartE2EDuration="22.061216619s" totalImagesPullingTime="18.773158285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.060877182 +0000 UTC m=+22.522367678" watchObservedRunningTime="2026-07-29 15:02:06.061216619 +0000 UTC m=+22.522707114" Jul 29 15:02:06.118187 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.118134 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d24pq" podStartSLOduration=3.355148763 podStartE2EDuration="22.118117844s" totalImagesPullingTime="18.762969081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.11793137 +0000 UTC m=+22.579421865" watchObservedRunningTime="2026-07-29 15:02:06.118117844 +0000 UTC m=+22.579608340" Jul 29 15:02:06.138857 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.138809 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zqfgt" podStartSLOduration=3.749936689 podStartE2EDuration="23.138793828s" totalImagesPullingTime="19.388857139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.138432837 +0000 UTC m=+22.599923334" watchObservedRunningTime="2026-07-29 15:02:06.138793828 +0000 UTC m=+22.600284324" Jul 29 15:02:06.156338 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.156290 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-skv67" podStartSLOduration=3.358798938 podStartE2EDuration="22.156271472s" totalImagesPullingTime="18.797472534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.155894684 +0000 UTC m=+22.617385179" watchObservedRunningTime="2026-07-29 15:02:06.156271472 +0000 UTC m=+22.617761971" Jul 29 15:02:06.171030 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.170974 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v6t5n" podStartSLOduration=7.480543714 podStartE2EDuration="22.170958429s" totalImagesPullingTime="14.690414715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.170692544 +0000 UTC m=+22.632183041" watchObservedRunningTime="2026-07-29 15:02:06.170958429 +0000 UTC m=+22.632448924" Jul 29 15:02:06.644203 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.644168 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:02:06.644835 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.644809 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:02:06.968466 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:06.968395 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:06.969002 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:06.968538 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:07.046619 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.046587 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k6gx" event={"ID":"fee60bb3-da92-4fef-8f8c-157442bac820","Type":"ContainerStarted","Data":"01b0d88c45f9d6e1d81fbb010535d08ea1c9d0e09d340bbd581c0eb8b0e08c50"} Jul 29 15:02:07.048470 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.048433 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" event={"ID":"10eeb41e26f8439ae2048b37f0fdde32","Type":"ContainerStarted","Data":"a2178909415371ad87fca39ea5a0244a22f1677dc61bbcc9595a41aefbb8a22d"} Jul 29 15:02:07.049027 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.048964 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:02:07.049657 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.049396 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qvvrs" Jul 29 15:02:07.063016 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.062972 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8k6gx" podStartSLOduration=8.358093845 podStartE2EDuration="23.062957108s" totalImagesPullingTime="14.704863263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.062610328 +0000 UTC m=+23.524100824" watchObservedRunningTime="2026-07-29 15:02:07.062957108 +0000 UTC m=+23.524447604" Jul 29 15:02:07.121151 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.121134 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:02:07.935412 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.935291 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:02:07.121148774Z","UUID":"db6c3259-defe-416d-8d4d-548b94121192","Handler":null,"Name":"","Endpoint":""} Jul 29 15:02:07.937056 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.937032 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:02:07.937179 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.937079 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:02:07.968058 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.968028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:07.968216 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:07.968032 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:07.968216 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:07.968144 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:07.968216 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:07.968196 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:08.053303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:08.053206 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" event={"ID":"f2710b3e-61bb-486a-9777-3fdbff4b5913","Type":"ContainerStarted","Data":"a4e2003a3162f7f5d9ca926184f503eca074502bd68558ce5f10bf1689e027b5"} Jul 29 15:02:08.057520 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:08.057497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:02:08.058123 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:08.058092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"a866521081ed928d8bbb723198880dd7263e37a9ccc42ed3d7a0f8c393f4177e"} Jul 29 15:02:08.968783 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:08.968750 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:08.968952 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:08.968891 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:09.062804 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:09.062766 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" event={"ID":"f2710b3e-61bb-486a-9777-3fdbff4b5913","Type":"ContainerStarted","Data":"efcc2c3305addc8e583268cc7884a45f4f2567fe8c550e807fa7784206e0d17a"} Jul 29 15:02:09.082231 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:09.082174 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pllhx" podStartSLOduration=3.792500311 podStartE2EDuration="25.082152708s" totalImagesPullingTime="21.289652397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:09.081365716 +0000 UTC m=+25.542856213" watchObservedRunningTime="2026-07-29 15:02:09.082152708 +0000 UTC m=+25.543643207" Jul 29 15:02:09.083123 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:09.083076 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-6.ec2.internal" podStartSLOduration=24.083059534 podStartE2EDuration="24.083059534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.104547751 +0000 UTC m=+23.566038247" watchObservedRunningTime="2026-07-29 15:02:09.083059534 +0000 UTC m=+25.544550031" Jul 29 15:02:09.969016 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:09.968805 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:09.969196 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:09.968805 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:09.969196 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:09.969123 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:09.969196 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:09.969164 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:10.968151 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:10.967991 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:10.968151 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:10.968130 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:11.070474 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.070446 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:02:11.070874 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.070848 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"1fa6e77ddda0a163282b269190cdceed83f4a42a0e0754160c917a403b72610e"} Jul 29 15:02:11.071107 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.071084 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:11.071469 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.071291 2583 scope.go:117] "RemoveContainer" containerID="e5bbbfc8af8468d052c335abed9e9f47652ae0dc350b5c8aa1e717bfacca4d29" Jul 29 15:02:11.072901 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.072865 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="d8a879cf0d25583c5f2b5ea0fed0ec2b56d7ac7d0ae51ceb9f1ca3473e814209" exitCode=0 Jul 29 15:02:11.072989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.072919 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"d8a879cf0d25583c5f2b5ea0fed0ec2b56d7ac7d0ae51ceb9f1ca3473e814209"} Jul 29 15:02:11.089944 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.089752 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:11.968328 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.968293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:11.968832 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:11.968298 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:11.968832 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:11.968397 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:11.968832 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:11.968461 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:12.078924 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.078897 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:02:12.079294 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.079274 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" event={"ID":"3548b7b6-2bde-4aff-ba4e-426360667b84","Type":"ContainerStarted","Data":"0d6f0e26855c63e2abeede70f93ff0bb1fb07ba7a99277e9545966010b0c90a1"} Jul 29 15:02:12.079427 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.079415 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:12.079476 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.079465 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:12.081500 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.081476 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="72245b1547fc00d751be8fd0f2e0794a2e33989761c4208e33e9087c6e860186" exitCode=0 Jul 29 15:02:12.081622 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.081512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"72245b1547fc00d751be8fd0f2e0794a2e33989761c4208e33e9087c6e860186"} Jul 29 15:02:12.097252 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.097226 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:12.111973 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.111930 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" podStartSLOduration=9.316035337 podStartE2EDuration="28.111913875s" totalImagesPullingTime="18.795878538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:12.111379303 +0000 UTC m=+28.572869800" watchObservedRunningTime="2026-07-29 15:02:12.111913875 +0000 UTC m=+28.573404370" Jul 29 15:02:12.968209 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:12.968165 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:12.968453 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:12.968316 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:13.013998 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.013960 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjwrx"] Jul 29 15:02:13.014176 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.014093 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:13.014245 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:13.014188 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:13.017587 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.017557 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcfdp"] Jul 29 15:02:13.017743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.017680 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:13.017842 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:13.017803 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:13.018007 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.017980 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ks9kp"] Jul 29 15:02:13.083423 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:13.083344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:13.083558 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:13.083493 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:14.968989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:14.968817 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:14.969381 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:14.968838 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:14.969381 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:14.969094 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:14.969381 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:14.968849 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:14.969381 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:14.969151 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:14.969381 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:14.969193 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:15.089500 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:15.089469 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="1ec2c925165525b5f84e6fc9544e853863fcb4a2887038ccb1c18003278d3015" exitCode=0 Jul 29 15:02:15.089500 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:15.089504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"1ec2c925165525b5f84e6fc9544e853863fcb4a2887038ccb1c18003278d3015"} Jul 29 15:02:16.968152 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:16.968112 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:16.968152 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:16.968144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:16.968634 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:16.968119 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:16.968634 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:16.968264 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9kp" podUID="66a880ce-7fe5-4b08-94fc-e666cbdc59dd" Jul 29 15:02:16.968634 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:16.968283 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfdp" podUID="a34dc8b4-b605-4919-8b1d-3ff992a3fd02" Jul 29 15:02:16.968634 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:16.968388 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjwrx" podUID="e4f0425b-802f-4b3a-b2eb-a7747778dfde" Jul 29 15:02:17.623060 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:17.623023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:17.623259 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:17.623073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:17.623259 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.623178 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:17.623259 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.623243 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret podName:e4f0425b-802f-4b3a-b2eb-a7747778dfde nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.623222109 +0000 UTC m=+66.084712583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret") pod "global-pull-secret-syncer-jjwrx" (UID: "e4f0425b-802f-4b3a-b2eb-a7747778dfde") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:17.623600 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.623178 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:17.623714 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.623643 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs podName:66a880ce-7fe5-4b08-94fc-e666cbdc59dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.62362547 +0000 UTC m=+66.085115948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs") pod "network-metrics-daemon-ks9kp" (UID: "66a880ce-7fe5-4b08-94fc-e666cbdc59dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:17.724040 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:17.724000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:17.724241 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.724195 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:17.724241 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.724219 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:17.724241 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.724228 2583 projected.go:196] Error preparing data for projected volume kube-api-access-vtmpm for pod openshift-network-diagnostics/network-check-target-xcfdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:17.724376 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:17.724292 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm podName:a34dc8b4-b605-4919-8b1d-3ff992a3fd02 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.724274787 +0000 UTC m=+66.185765261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vtmpm" (UniqueName: "kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm") pod "network-check-target-xcfdp" (UID: "a34dc8b4-b605-4919-8b1d-3ff992a3fd02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:18.363270 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.363237 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-6.ec2.internal" event="NodeReady" Jul 29 15:02:18.363978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.363404 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:02:18.427479 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.427443 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d6jxv"] Jul 29 15:02:18.461355 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.461324 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-skv29"] Jul 29 15:02:18.461544 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.461460 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.465060 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.464847 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:02:18.465060 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.464951 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hpln\"" Jul 29 15:02:18.465060 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.464849 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:02:18.475362 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.475327 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skv29"] Jul 29 15:02:18.475489 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.475372 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6jxv"] Jul 29 15:02:18.475489 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.475455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.478309 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.478290 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vjkks\"" Jul 29 15:02:18.478422 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.478321 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:02:18.478582 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.478566 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:02:18.478788 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.478774 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:02:18.631770 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631670 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhrs7\" (UniqueName: \"kubernetes.io/projected/754c15e6-cffe-49f2-9287-403c2f7c7bf2-kube-api-access-rhrs7\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.631770 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/754c15e6-cffe-49f2-9287-403c2f7c7bf2-config-volume\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.631991 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.631991 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-cert\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.631991 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754c15e6-cffe-49f2-9287-403c2f7c7bf2-tmp-dir\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.631991 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.631889 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7n4b\" (UniqueName: \"kubernetes.io/projected/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-kube-api-access-t7n4b\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.732995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.732958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/754c15e6-cffe-49f2-9287-403c2f7c7bf2-config-volume\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.732995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.732999 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.733243 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-cert\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.733243 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:18.733132 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:18.733243 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733141 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754c15e6-cffe-49f2-9287-403c2f7c7bf2-tmp-dir\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.733243 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7n4b\" (UniqueName: \"kubernetes.io/projected/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-kube-api-access-t7n4b\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.733243 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:18.733208 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:19.233184834 +0000 UTC m=+35.694675344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:18.733492 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733257 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhrs7\" (UniqueName: \"kubernetes.io/projected/754c15e6-cffe-49f2-9287-403c2f7c7bf2-kube-api-access-rhrs7\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.733492 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733411 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754c15e6-cffe-49f2-9287-403c2f7c7bf2-tmp-dir\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.733568 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.733536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/754c15e6-cffe-49f2-9287-403c2f7c7bf2-config-volume\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.737995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.737964 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-cert\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.751969 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.751943 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhrs7\" (UniqueName: \"kubernetes.io/projected/754c15e6-cffe-49f2-9287-403c2f7c7bf2-kube-api-access-rhrs7\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:18.752109 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.752095 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7n4b\" (UniqueName: \"kubernetes.io/projected/76c5d043-eaa6-43b1-b03b-990ddcbc3e29-kube-api-access-t7n4b\") pod \"ingress-canary-skv29\" (UID: \"76c5d043-eaa6-43b1-b03b-990ddcbc3e29\") " pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.785592 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.785563 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skv29" Jul 29 15:02:18.968341 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.968258 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:18.968341 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.968301 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:18.968341 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.968261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:18.972320 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.972294 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:18.972473 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.972330 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:02:18.973308 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.973285 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:02:18.973513 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.973494 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:18.973621 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.973584 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vj5ch\"" Jul 29 15:02:18.973684 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:18.973670 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-scjxg\"" Jul 29 15:02:19.237256 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:19.237182 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:19.237388 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:19.237299 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:19.237388 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:19.237355 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:20.237339973 +0000 UTC m=+36.698830448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:19.257388 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:19.257288 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skv29"] Jul 29 15:02:19.283522 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:19.283484 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c5d043_eaa6_43b1_b03b_990ddcbc3e29.slice/crio-f633062060e471ee0fcb330a7c69daf8a1229fb89d03ac9094cfeeff13fa89f9 WatchSource:0}: Error finding container f633062060e471ee0fcb330a7c69daf8a1229fb89d03ac9094cfeeff13fa89f9: Status 404 returned error can't find the container with id f633062060e471ee0fcb330a7c69daf8a1229fb89d03ac9094cfeeff13fa89f9 Jul 29 15:02:20.106436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:20.106180 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="d425975f03d1b06ecbc5ece98a58c9ea9fd47624816e9239b2327c5a3324da7a" exitCode=0 Jul 29 15:02:20.107204 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:20.106259 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"d425975f03d1b06ecbc5ece98a58c9ea9fd47624816e9239b2327c5a3324da7a"} Jul 29 15:02:20.107814 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:20.107793 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skv29" event={"ID":"76c5d043-eaa6-43b1-b03b-990ddcbc3e29","Type":"ContainerStarted","Data":"f633062060e471ee0fcb330a7c69daf8a1229fb89d03ac9094cfeeff13fa89f9"} Jul 29 15:02:20.243247 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:20.243165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:20.243429 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:20.243303 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:20.243429 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:20.243367 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:22.243350899 +0000 UTC m=+38.704841372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:21.113530 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:21.113495 2583 generic.go:356] "Generic (PLEG): container finished" podID="86599312-b29d-4a37-a0c4-4bba97dabae3" containerID="48ebc502eb1d77e6e972119811b589e694bc21b785e899a856a572df7d74287d" exitCode=0 Jul 29 15:02:21.113987 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:21.113542 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerDied","Data":"48ebc502eb1d77e6e972119811b589e694bc21b785e899a856a572df7d74287d"} Jul 29 15:02:22.117891 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:22.117668 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skv29" event={"ID":"76c5d043-eaa6-43b1-b03b-990ddcbc3e29","Type":"ContainerStarted","Data":"a720d32cd17c81bde6205dbbb8a0af3950acff98ba075e3061fc11c9cb2913b6"} Jul 29 15:02:22.121102 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:22.121077 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g4df6" event={"ID":"86599312-b29d-4a37-a0c4-4bba97dabae3","Type":"ContainerStarted","Data":"538230448f1cd3528d17375150c1149fd988c020ff7340c919293291555ad8aa"} Jul 29 15:02:22.136249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:22.136198 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-skv29" podStartSLOduration=1.711857862 podStartE2EDuration="4.136180864s" totalImagesPullingTime="2.424323002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:22.135093098 +0000 UTC m=+38.596583595" watchObservedRunningTime="2026-07-29 15:02:22.136180864 +0000 UTC m=+38.597671360" Jul 29 15:02:22.168220 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:22.168170 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g4df6" podStartSLOduration=15.202137586 podStartE2EDuration="38.168153727s" totalImagesPullingTime="22.966016141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:22.166719452 +0000 UTC m=+38.628209949" watchObservedRunningTime="2026-07-29 15:02:22.168153727 +0000 UTC m=+38.629644219" Jul 29 15:02:22.260145 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:22.260107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:22.260340 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:22.260252 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:22.260340 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:22.260325 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.26030623 +0000 UTC m=+42.721796734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:26.289925 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:26.289883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:26.290410 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:26.290063 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:26.290410 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:26.290149 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:34.290126175 +0000 UTC m=+50.751616650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:28.466736 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.466686 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7"] Jul 29 15:02:28.501590 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.501556 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm"] Jul 29 15:02:28.501754 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.501686 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" Jul 29 15:02:28.506383 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.506358 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:02:28.507369 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.507300 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6npzf\"" Jul 29 15:02:28.507369 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.507330 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 15:02:28.517780 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.517751 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7"] Jul 29 15:02:28.517907 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.517798 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm"] Jul 29 15:02:28.517907 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.517822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.522940 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.522921 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 15:02:28.528421 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.528397 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:02:28.528421 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.528415 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9llvx\"" Jul 29 15:02:28.528640 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.528627 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 15:02:28.528681 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.528653 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 15:02:28.587247 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.587206 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:02:28.604842 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.604808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.604842 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.604872 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcckk\" (UniqueName: \"kubernetes.io/projected/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-kube-api-access-tcckk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.605105 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.604927 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.605105 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.604992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhgk\" (UniqueName: \"kubernetes.io/projected/4d530559-ce2f-4095-9dc9-df0be691a22f-kube-api-access-7rhgk\") pod \"volume-data-source-validator-549c6d54cf-nckg7\" (UID: \"4d530559-ce2f-4095-9dc9-df0be691a22f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" Jul 29 15:02:28.611689 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.611663 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:02:28.611826 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.611774 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.614594 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.614568 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xh4rx\"" Jul 29 15:02:28.614594 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.614584 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:02:28.614816 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.614643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:02:28.615927 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.615910 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:02:28.622243 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.622226 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:02:28.705517 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcckk\" (UniqueName: \"kubernetes.io/projected/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-kube-api-access-tcckk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705576 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.705695 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhgk\" (UniqueName: \"kubernetes.io/projected/4d530559-ce2f-4095-9dc9-df0be691a22f-kube-api-access-7rhgk\") pod \"volume-data-source-validator-549c6d54cf-nckg7\" (UID: \"4d530559-ce2f-4095-9dc9-df0be691a22f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" Jul 29 15:02:28.706076 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.706076 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.706076 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705847 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.706076 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.705876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hzv\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.706289 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.706271 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.709529 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.709511 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.717670 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.717601 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhgk\" (UniqueName: \"kubernetes.io/projected/4d530559-ce2f-4095-9dc9-df0be691a22f-kube-api-access-7rhgk\") pod \"volume-data-source-validator-549c6d54cf-nckg7\" (UID: \"4d530559-ce2f-4095-9dc9-df0be691a22f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" Jul 29 15:02:28.717952 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.717934 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcckk\" (UniqueName: \"kubernetes.io/projected/6a5cc648-ad7f-4049-b0e4-8d7dfd0009da-kube-api-access-tcckk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm\" (UID: \"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.806360 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806360 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hzv\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806506 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806569 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.806559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.806909 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:28.806665 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:28.806909 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:28.806683 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6669c7db5c-tkfw7: secret "image-registry-tls" not found Jul 29 15:02:28.806909 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:28.806774 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls podName:d49e1bc7-a48d-491d-85ac-2d346172bf3c nodeName:}" failed. No retries permitted until 2026-07-29 15:02:29.306752467 +0000 UTC m=+45.768242953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls") pod "image-registry-6669c7db5c-tkfw7" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c") : secret "image-registry-tls" not found Jul 29 15:02:28.807071 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.807018 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.807312 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.807292 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.807655 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.807639 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.808998 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.808979 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.809045 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.809005 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.811219 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.811206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" Jul 29 15:02:28.821477 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.821449 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.823216 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.823198 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hzv\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:28.826014 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.825998 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" Jul 29 15:02:28.985650 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:28.985578 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7"] Jul 29 15:02:28.989271 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:28.989238 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d530559_ce2f_4095_9dc9_df0be691a22f.slice/crio-8fdc231af0cfc170d8eefc34798d4352c2b123a3868b907d3a3cd7fbab91691b WatchSource:0}: Error finding container 8fdc231af0cfc170d8eefc34798d4352c2b123a3868b907d3a3cd7fbab91691b: Status 404 returned error can't find the container with id 8fdc231af0cfc170d8eefc34798d4352c2b123a3868b907d3a3cd7fbab91691b Jul 29 15:02:29.006553 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:29.006517 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm"] Jul 29 15:02:29.009786 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:29.009761 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5cc648_ad7f_4049_b0e4_8d7dfd0009da.slice/crio-654b69c182690795eafe3eb78c25e81ffeded64776db4c9020b2d43d7a887478 WatchSource:0}: Error finding container 654b69c182690795eafe3eb78c25e81ffeded64776db4c9020b2d43d7a887478: Status 404 returned error can't find the container with id 654b69c182690795eafe3eb78c25e81ffeded64776db4c9020b2d43d7a887478 Jul 29 15:02:29.138001 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:29.137958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" event={"ID":"4d530559-ce2f-4095-9dc9-df0be691a22f","Type":"ContainerStarted","Data":"8fdc231af0cfc170d8eefc34798d4352c2b123a3868b907d3a3cd7fbab91691b"} Jul 29 15:02:29.139039 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:29.139014 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" event={"ID":"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da","Type":"ContainerStarted","Data":"654b69c182690795eafe3eb78c25e81ffeded64776db4c9020b2d43d7a887478"} Jul 29 15:02:29.310135 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:29.310096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:29.310321 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:29.310220 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:29.310321 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:29.310234 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6669c7db5c-tkfw7: secret "image-registry-tls" not found Jul 29 15:02:29.310321 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:29.310294 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls podName:d49e1bc7-a48d-491d-85ac-2d346172bf3c nodeName:}" failed. No retries permitted until 2026-07-29 15:02:30.310280323 +0000 UTC m=+46.771770796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls") pod "image-registry-6669c7db5c-tkfw7" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c") : secret "image-registry-tls" not found Jul 29 15:02:30.319097 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:30.319054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:30.319656 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:30.319217 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:30.319656 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:30.319233 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6669c7db5c-tkfw7: secret "image-registry-tls" not found Jul 29 15:02:30.319656 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:30.319290 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls podName:d49e1bc7-a48d-491d-85ac-2d346172bf3c nodeName:}" failed. No retries permitted until 2026-07-29 15:02:32.319272625 +0000 UTC m=+48.780763107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls") pod "image-registry-6669c7db5c-tkfw7" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c") : secret "image-registry-tls" not found Jul 29 15:02:32.148078 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:32.148047 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" event={"ID":"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da","Type":"ContainerStarted","Data":"ac7a138d58ee0c4d336f6c52d78a599704dfd969bf3942d270b5713276bb5c6e"} Jul 29 15:02:32.180988 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:32.180938 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" podStartSLOduration=1.7457493880000001 podStartE2EDuration="4.180922212s" totalImagesPullingTime="2.435172824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:32.179481018 +0000 UTC m=+48.640971515" watchObservedRunningTime="2026-07-29 15:02:32.180922212 +0000 UTC m=+48.642412685" Jul 29 15:02:32.333925 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:32.333883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:32.334117 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:32.334024 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:32.334117 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:32.334045 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6669c7db5c-tkfw7: secret "image-registry-tls" not found Jul 29 15:02:32.334117 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:32.334109 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls podName:d49e1bc7-a48d-491d-85ac-2d346172bf3c nodeName:}" failed. No retries permitted until 2026-07-29 15:02:36.33409078 +0000 UTC m=+52.795581277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls") pod "image-registry-6669c7db5c-tkfw7" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c") : secret "image-registry-tls" not found Jul 29 15:02:33.152285 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.152251 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" event={"ID":"4d530559-ce2f-4095-9dc9-df0be691a22f","Type":"ContainerStarted","Data":"404c15f2e8d993cfe0b6753f7ef7fe9f6444777b24f510163884f52f36200dd9"} Jul 29 15:02:33.192417 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.192363 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nckg7" podStartSLOduration=1.707908999 podStartE2EDuration="5.192343951s" totalImagesPullingTime="3.484434952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:33.183159561 +0000 UTC m=+49.644650055" watchObservedRunningTime="2026-07-29 15:02:33.192343951 +0000 UTC m=+49.653834447" Jul 29 15:02:33.366219 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.366184 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bvlql"] Jul 29 15:02:33.386649 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.386609 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.390176 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.390150 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:02:33.390694 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.390673 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:02:33.391015 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.391000 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwpgj\"" Jul 29 15:02:33.391114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.391006 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:02:33.391263 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.391247 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:02:33.395988 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.395571 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bvlql"] Jul 29 15:02:33.543408 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.543381 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp7b2\" (UniqueName: \"kubernetes.io/projected/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-api-access-lp7b2\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.543563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.543446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.543563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.543478 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/735f57de-b8ff-4c41-a20b-7007fe890fbb-crio-socket\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.543563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.543531 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/735f57de-b8ff-4c41-a20b-7007fe890fbb-data-volume\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.543672 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.543569 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.644743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.644690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/735f57de-b8ff-4c41-a20b-7007fe890fbb-data-volume\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.644743 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.644747 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.644935 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.644836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp7b2\" (UniqueName: \"kubernetes.io/projected/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-api-access-lp7b2\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.644935 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:33.644865 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:33.644935 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.644889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.644935 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:33.644928 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:34.144909558 +0000 UTC m=+50.606400031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:33.645090 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.644945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/735f57de-b8ff-4c41-a20b-7007fe890fbb-crio-socket\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.645090 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:33.644949 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:33.645090 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.645033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/735f57de-b8ff-4c41-a20b-7007fe890fbb-data-volume\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.645090 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:33.645074 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:34.145062263 +0000 UTC m=+50.606552751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:33.645217 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.645141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/735f57de-b8ff-4c41-a20b-7007fe890fbb-crio-socket\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:33.656614 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:33.656581 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp7b2\" (UniqueName: \"kubernetes.io/projected/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-api-access-lp7b2\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:34.149924 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:34.149892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:34.150099 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:34.149958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:34.150099 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.150024 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:34.150099 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.150050 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:34.150099 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.150099 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:35.150082626 +0000 UTC m=+51.611573104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:34.150249 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.150114 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:35.150108072 +0000 UTC m=+51.611598546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:34.351816 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:34.351779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:34.352172 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.351900 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:34.352172 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:34.351954 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls podName:754c15e6-cffe-49f2-9287-403c2f7c7bf2 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:50.351941352 +0000 UTC m=+66.813431830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls") pod "dns-default-d6jxv" (UID: "754c15e6-cffe-49f2-9287-403c2f7c7bf2") : secret "dns-default-metrics-tls" not found Jul 29 15:02:35.158874 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:35.158841 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:35.159051 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:35.158921 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:35.159051 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:35.158991 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:35.159051 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:35.159030 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:35.159157 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:35.159068 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:37.159049083 +0000 UTC m=+53.620539559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:35.159157 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:35.159084 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:37.15907809 +0000 UTC m=+53.620568563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:35.894719 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:35.894692 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d24pq_dbda1a84-932c-4c2d-8dfb-7eee5f080dbf/dns-node-resolver/0.log" Jul 29 15:02:36.368265 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:36.368220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:36.368428 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:36.368375 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:36.368428 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:36.368393 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6669c7db5c-tkfw7: secret "image-registry-tls" not found Jul 29 15:02:36.368499 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:36.368447 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls podName:d49e1bc7-a48d-491d-85ac-2d346172bf3c nodeName:}" failed. No retries permitted until 2026-07-29 15:02:44.368433146 +0000 UTC m=+60.829923619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls") pod "image-registry-6669c7db5c-tkfw7" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c") : secret "image-registry-tls" not found Jul 29 15:02:37.173599 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:37.173559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:37.174066 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:37.173630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:37.174066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:37.173693 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:37.174066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:37.173744 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:37.174066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:37.173782 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:41.173767454 +0000 UTC m=+57.635257928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:37.174066 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:37.173807 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:41.173793289 +0000 UTC m=+57.635283766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:37.292524 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:37.292497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6t5n_ddd5073b-4652-4ce0-ae7f-ff0d32952135/node-ca/0.log" Jul 29 15:02:38.094835 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:38.094805 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skv29_76c5d043-eaa6-43b1-b03b-990ddcbc3e29/serve-healthcheck-canary/0.log" Jul 29 15:02:38.692276 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:38.692245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm_6a5cc648-ad7f-4049-b0e4-8d7dfd0009da/kube-storage-version-migrator-operator/0.log" Jul 29 15:02:41.205044 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:41.205002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:41.205506 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:41.205086 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:41.205506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:41.205129 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:41.205506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:41.205185 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:41.205506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:41.205202 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.205185061 +0000 UTC m=+65.666675555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:41.205506 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:02:41.205248 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls podName:735f57de-b8ff-4c41-a20b-7007fe890fbb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.205236323 +0000 UTC m=+65.666726796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bvlql" (UID: "735f57de-b8ff-4c41-a20b-7007fe890fbb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:44.096271 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.096234 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fknlj" Jul 29 15:02:44.430429 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.430315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:44.432703 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.432672 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"image-registry-6669c7db5c-tkfw7\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:44.524107 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.524071 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xh4rx\"" Jul 29 15:02:44.532253 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.532225 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:44.663965 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:44.663929 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:02:44.667191 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:44.667151 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49e1bc7_a48d_491d_85ac_2d346172bf3c.slice/crio-3992b1b57758f718814f833633b3a27197e4f086c058af05e185ce0e9d36c18f WatchSource:0}: Error finding container 3992b1b57758f718814f833633b3a27197e4f086c058af05e185ce0e9d36c18f: Status 404 returned error can't find the container with id 3992b1b57758f718814f833633b3a27197e4f086c058af05e185ce0e9d36c18f Jul 29 15:02:45.181085 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:45.181048 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" event={"ID":"d49e1bc7-a48d-491d-85ac-2d346172bf3c","Type":"ContainerStarted","Data":"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a"} Jul 29 15:02:45.181456 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:45.181096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" event={"ID":"d49e1bc7-a48d-491d-85ac-2d346172bf3c","Type":"ContainerStarted","Data":"3992b1b57758f718814f833633b3a27197e4f086c058af05e185ce0e9d36c18f"} Jul 29 15:02:45.181456 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:45.181180 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:02:45.206137 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:45.206064 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" podStartSLOduration=17.206044925 podStartE2EDuration="17.206044925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:45.205098594 +0000 UTC m=+61.666589090" watchObservedRunningTime="2026-07-29 15:02:45.206044925 +0000 UTC m=+61.667535423" Jul 29 15:02:49.271512 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.271470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:49.271944 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.271550 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:49.272109 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.272089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/735f57de-b8ff-4c41-a20b-7007fe890fbb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:49.273774 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.273752 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/735f57de-b8ff-4c41-a20b-7007fe890fbb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bvlql\" (UID: \"735f57de-b8ff-4c41-a20b-7007fe890fbb\") " pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:49.299796 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.299764 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwpgj\"" Jul 29 15:02:49.307614 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.307592 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bvlql" Jul 29 15:02:49.475566 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.475533 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bvlql"] Jul 29 15:02:49.479051 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:49.479023 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735f57de_b8ff_4c41_a20b_7007fe890fbb.slice/crio-de1f80920a732a1e7b38ef9269a8ea6b7bf93a6144ebcffd1cbabd73be27bc62 WatchSource:0}: Error finding container de1f80920a732a1e7b38ef9269a8ea6b7bf93a6144ebcffd1cbabd73be27bc62: Status 404 returned error can't find the container with id de1f80920a732a1e7b38ef9269a8ea6b7bf93a6144ebcffd1cbabd73be27bc62 Jul 29 15:02:49.674793 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.674655 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:49.674793 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.674791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:49.677223 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.677203 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:49.677314 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.677287 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:49.687271 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.687241 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4f0425b-802f-4b3a-b2eb-a7747778dfde-original-pull-secret\") pod \"global-pull-secret-syncer-jjwrx\" (UID: \"e4f0425b-802f-4b3a-b2eb-a7747778dfde\") " pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:49.687379 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.687333 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a880ce-7fe5-4b08-94fc-e666cbdc59dd-metrics-certs\") pod \"network-metrics-daemon-ks9kp\" (UID: \"66a880ce-7fe5-4b08-94fc-e666cbdc59dd\") " pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:49.775764 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.775704 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:49.778384 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.778364 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:02:49.788935 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.788914 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:02:49.799370 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.799351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmpm\" (UniqueName: \"kubernetes.io/projected/a34dc8b4-b605-4919-8b1d-3ff992a3fd02-kube-api-access-vtmpm\") pod \"network-check-target-xcfdp\" (UID: \"a34dc8b4-b605-4919-8b1d-3ff992a3fd02\") " pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:49.882984 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.882950 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-scjxg\"" Jul 29 15:02:49.887711 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.887693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjwrx" Jul 29 15:02:49.891856 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.891836 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:49.895152 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.895133 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vj5ch\"" Jul 29 15:02:49.903775 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:49.903755 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9kp" Jul 29 15:02:50.052764 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.052716 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjwrx"] Jul 29 15:02:50.057049 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:50.057015 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f0425b_802f_4b3a_b2eb_a7747778dfde.slice/crio-abfa179d2fb0df588745c62448411312ca50de6b84f54bbc0500eb5e6ad53bcd WatchSource:0}: Error finding container abfa179d2fb0df588745c62448411312ca50de6b84f54bbc0500eb5e6ad53bcd: Status 404 returned error can't find the container with id abfa179d2fb0df588745c62448411312ca50de6b84f54bbc0500eb5e6ad53bcd Jul 29 15:02:50.101399 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.101373 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcfdp"] Jul 29 15:02:50.103636 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:50.103609 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34dc8b4_b605_4919_8b1d_3ff992a3fd02.slice/crio-87af5a982dfbd394b8a133127258c03667f910e282ffa1a9a7fdb44bc4abe15d WatchSource:0}: Error finding container 87af5a982dfbd394b8a133127258c03667f910e282ffa1a9a7fdb44bc4abe15d: Status 404 returned error can't find the container with id 87af5a982dfbd394b8a133127258c03667f910e282ffa1a9a7fdb44bc4abe15d Jul 29 15:02:50.122842 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.122812 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ks9kp"] Jul 29 15:02:50.126112 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:50.126086 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a880ce_7fe5_4b08_94fc_e666cbdc59dd.slice/crio-c2b8dfaa1ae5c06b57b9b160207de696460b2d411051b86a8f60eb3721862ec6 WatchSource:0}: Error finding container c2b8dfaa1ae5c06b57b9b160207de696460b2d411051b86a8f60eb3721862ec6: Status 404 returned error can't find the container with id c2b8dfaa1ae5c06b57b9b160207de696460b2d411051b86a8f60eb3721862ec6 Jul 29 15:02:50.194324 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.194288 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcfdp" event={"ID":"a34dc8b4-b605-4919-8b1d-3ff992a3fd02","Type":"ContainerStarted","Data":"87af5a982dfbd394b8a133127258c03667f910e282ffa1a9a7fdb44bc4abe15d"} Jul 29 15:02:50.195368 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.195340 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjwrx" event={"ID":"e4f0425b-802f-4b3a-b2eb-a7747778dfde","Type":"ContainerStarted","Data":"abfa179d2fb0df588745c62448411312ca50de6b84f54bbc0500eb5e6ad53bcd"} Jul 29 15:02:50.196294 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.196275 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9kp" event={"ID":"66a880ce-7fe5-4b08-94fc-e666cbdc59dd","Type":"ContainerStarted","Data":"c2b8dfaa1ae5c06b57b9b160207de696460b2d411051b86a8f60eb3721862ec6"} Jul 29 15:02:50.197249 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.197230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bvlql" event={"ID":"735f57de-b8ff-4c41-a20b-7007fe890fbb","Type":"ContainerStarted","Data":"de1f80920a732a1e7b38ef9269a8ea6b7bf93a6144ebcffd1cbabd73be27bc62"} Jul 29 15:02:50.380613 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.380566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:50.382975 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.382951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/754c15e6-cffe-49f2-9287-403c2f7c7bf2-metrics-tls\") pod \"dns-default-d6jxv\" (UID: \"754c15e6-cffe-49f2-9287-403c2f7c7bf2\") " pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:50.575180 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.575138 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hpln\"" Jul 29 15:02:50.582623 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.582590 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:50.730665 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:50.730628 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6jxv"] Jul 29 15:02:50.734481 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:02:50.734454 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754c15e6_cffe_49f2_9287_403c2f7c7bf2.slice/crio-ff4e376b993c2cc31a734b54a12c065c20a18d4bc9aa67c01b59fe600bece8be WatchSource:0}: Error finding container ff4e376b993c2cc31a734b54a12c065c20a18d4bc9aa67c01b59fe600bece8be: Status 404 returned error can't find the container with id ff4e376b993c2cc31a734b54a12c065c20a18d4bc9aa67c01b59fe600bece8be Jul 29 15:02:51.205145 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:51.205106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6jxv" event={"ID":"754c15e6-cffe-49f2-9287-403c2f7c7bf2","Type":"ContainerStarted","Data":"ff4e376b993c2cc31a734b54a12c065c20a18d4bc9aa67c01b59fe600bece8be"} Jul 29 15:02:52.214800 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:52.214690 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9kp" event={"ID":"66a880ce-7fe5-4b08-94fc-e666cbdc59dd","Type":"ContainerStarted","Data":"48c44924659e4523bdce2cf3c3289a0d49a6ae6c072ae13bdba493c6ae67ace6"} Jul 29 15:02:52.214800 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:52.214780 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9kp" event={"ID":"66a880ce-7fe5-4b08-94fc-e666cbdc59dd","Type":"ContainerStarted","Data":"e6d50fa27c96950181c2d3c5866276adee249a1c60338f259c92537c533a317b"} Jul 29 15:02:52.238257 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:52.238199 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ks9kp" podStartSLOduration=67.696432458 podStartE2EDuration="1m9.238173687s" totalImagesPullingTime="1.541741229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:52.236421418 +0000 UTC m=+68.697911913" watchObservedRunningTime="2026-07-29 15:02:52.238173687 +0000 UTC m=+68.699664185" Jul 29 15:02:59.241449 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.241406 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcfdp" event={"ID":"a34dc8b4-b605-4919-8b1d-3ff992a3fd02","Type":"ContainerStarted","Data":"809c4973499ac1ca38efe2a2f79e1db88c9379353a900891e77a661dd2a97e23"} Jul 29 15:02:59.241969 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.241707 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:02:59.243281 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.243250 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjwrx" event={"ID":"e4f0425b-802f-4b3a-b2eb-a7747778dfde","Type":"ContainerStarted","Data":"f989c89233c64564a3a15e3a14bebda37816f6b369bd01364e6b618f7dacc878"} Jul 29 15:02:59.245411 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.245387 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6jxv" event={"ID":"754c15e6-cffe-49f2-9287-403c2f7c7bf2","Type":"ContainerStarted","Data":"7b845956a2c4be10ac95243db1fb3c66dd3573981936b4ace4a8e5e1e354c58a"} Jul 29 15:02:59.245512 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.245436 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6jxv" event={"ID":"754c15e6-cffe-49f2-9287-403c2f7c7bf2","Type":"ContainerStarted","Data":"6cf50718a340dc376d55e46d71b84736e17e3511ec25069db4c324cb6656fc39"} Jul 29 15:02:59.245931 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.245913 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d6jxv" Jul 29 15:02:59.247622 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.247596 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bvlql" event={"ID":"735f57de-b8ff-4c41-a20b-7007fe890fbb","Type":"ContainerStarted","Data":"58be96abbb7da0f4dd7ab3abfa15b8ecd41b7d1818b92b9250c25ddec0a2bc12"} Jul 29 15:02:59.260607 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.260522 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xcfdp" podStartSLOduration=67.025359794 podStartE2EDuration="1m15.260506204s" totalImagesPullingTime="8.23514641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:59.260310706 +0000 UTC m=+75.721801203" watchObservedRunningTime="2026-07-29 15:02:59.260506204 +0000 UTC m=+75.721996701" Jul 29 15:02:59.276956 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.276903 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jjwrx" podStartSLOduration=66.995219123 podStartE2EDuration="1m15.276885132s" totalImagesPullingTime="8.281666009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:59.276281709 +0000 UTC m=+75.737772210" watchObservedRunningTime="2026-07-29 15:02:59.276885132 +0000 UTC m=+75.738375627" Jul 29 15:02:59.300920 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:02:59.300859 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d6jxv" podStartSLOduration=33.697091227 podStartE2EDuration="41.300836306s" totalImagesPullingTime="7.603745079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:59.299471818 +0000 UTC m=+75.760962313" watchObservedRunningTime="2026-07-29 15:02:59.300836306 +0000 UTC m=+75.762326803" Jul 29 15:03:01.379257 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.379218 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn"] Jul 29 15:03:01.395426 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.395396 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.398160 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.398132 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 15:03:01.398952 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.398929 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 15:03:01.398952 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.398941 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-59l6j\"" Jul 29 15:03:01.409054 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.409022 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp"] Jul 29 15:03:01.425653 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.425615 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn"] Jul 29 15:03:01.425879 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.425801 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.455020 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.454985 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 15:03:01.462989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.462956 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 15:03:01.463660 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.463632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 15:03:01.463808 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.463783 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 15:03:01.464501 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.464475 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:03:01.466662 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.466627 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp"] Jul 29 15:03:01.467019 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.466998 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a95c2cef-ea07-4830-9f70-3514c154f70f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.467083 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.467051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-tmp\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.467083 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.467082 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.467170 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.467119 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7fcq\" (UniqueName: \"kubernetes.io/projected/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-kube-api-access-k7fcq\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.467170 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.467156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a95c2cef-ea07-4830-9f70-3514c154f70f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.470079 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.470027 2583 patch_prober.go:28] interesting pod/image-registry-6669c7db5c-tkfw7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 15:03:01.470178 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.470104 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 15:03:01.521407 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.521372 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-xz8gp"] Jul 29 15:03:01.526399 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.526372 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:01.529261 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.529234 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xtx8q\"" Jul 29 15:03:01.529422 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.529357 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:03:01.529664 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.529640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:03:01.560867 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.560832 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xz8gp"] Jul 29 15:03:01.567855 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.567825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a95c2cef-ea07-4830-9f70-3514c154f70f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.568039 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.567868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-tmp\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.568039 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.567893 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.568039 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.567920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7fcq\" (UniqueName: \"kubernetes.io/projected/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-kube-api-access-k7fcq\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.568039 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.567950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a95c2cef-ea07-4830-9f70-3514c154f70f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.568704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.568674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a95c2cef-ea07-4830-9f70-3514c154f70f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.568704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.568698 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-tmp\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.571040 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.571015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a95c2cef-ea07-4830-9f70-3514c154f70f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kdzfn\" (UID: \"a95c2cef-ea07-4830-9f70-3514c154f70f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.571171 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.571153 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.592245 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.592217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7fcq\" (UniqueName: \"kubernetes.io/projected/3d0aeac5-14b3-4eb0-8021-d90674b5f11f-kube-api-access-k7fcq\") pod \"klusterlet-addon-workmgr-9bf8d6d76-rc9dp\" (UID: \"3d0aeac5-14b3-4eb0-8021-d90674b5f11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.629552 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.629471 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bd4598459-lgjmp"] Jul 29 15:03:01.633447 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.633426 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.668664 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.668534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzlw\" (UniqueName: \"kubernetes.io/projected/50137084-5fe9-4bf1-945b-d727d3006c81-kube-api-access-bnzlw\") pod \"downloads-7c97dc4555-xz8gp\" (UID: \"50137084-5fe9-4bf1-945b-d727d3006c81\") " pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:01.670587 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.670560 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd4598459-lgjmp"] Jul 29 15:03:01.709548 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.709514 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" Jul 29 15:03:01.737075 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.737038 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:01.770256 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-bound-sa-token\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-image-registry-private-configuration\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-installation-pull-secrets\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzlw\" (UniqueName: \"kubernetes.io/projected/50137084-5fe9-4bf1-945b-d727d3006c81-kube-api-access-bnzlw\") pod \"downloads-7c97dc4555-xz8gp\" (UID: \"50137084-5fe9-4bf1-945b-d727d3006c81\") " pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:01.770467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-tls\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-trusted-ca\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770711 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79w9g\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-kube-api-access-79w9g\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770711 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770512 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-certificates\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.770711 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.770545 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e7cb694-b81c-43ee-b71b-3c047f4803e2-ca-trust-extracted\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.785146 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.785113 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzlw\" (UniqueName: \"kubernetes.io/projected/50137084-5fe9-4bf1-945b-d727d3006c81-kube-api-access-bnzlw\") pod \"downloads-7c97dc4555-xz8gp\" (UID: \"50137084-5fe9-4bf1-945b-d727d3006c81\") " pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:01.836651 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.836609 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:01.871281 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871243 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-trusted-ca\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79w9g\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-kube-api-access-79w9g\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-certificates\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871337 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e7cb694-b81c-43ee-b71b-3c047f4803e2-ca-trust-extracted\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-bound-sa-token\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-image-registry-private-configuration\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-installation-pull-secrets\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871430 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-tls\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.871963 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.871936 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e7cb694-b81c-43ee-b71b-3c047f4803e2-ca-trust-extracted\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.872330 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.872306 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-certificates\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.872434 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.872366 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e7cb694-b81c-43ee-b71b-3c047f4803e2-trusted-ca\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.874134 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.874104 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-image-registry-private-configuration\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.874303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.874261 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-registry-tls\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.874357 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.874326 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e7cb694-b81c-43ee-b71b-3c047f4803e2-installation-pull-secrets\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.884926 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.884860 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79w9g\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-kube-api-access-79w9g\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.900353 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.900320 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e7cb694-b81c-43ee-b71b-3c047f4803e2-bound-sa-token\") pod \"image-registry-7bd4598459-lgjmp\" (UID: \"1e7cb694-b81c-43ee-b71b-3c047f4803e2\") " pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:01.943371 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:01.943336 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:02.140901 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.140816 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xz8gp"] Jul 29 15:03:02.146048 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:02.146019 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50137084_5fe9_4bf1_945b_d727d3006c81.slice/crio-e5b39fc8fe01e100c5a8d44eee1c816bd3944fa3e3df4e0cc83b329a107cda71 WatchSource:0}: Error finding container e5b39fc8fe01e100c5a8d44eee1c816bd3944fa3e3df4e0cc83b329a107cda71: Status 404 returned error can't find the container with id e5b39fc8fe01e100c5a8d44eee1c816bd3944fa3e3df4e0cc83b329a107cda71 Jul 29 15:03:02.168437 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.168405 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp"] Jul 29 15:03:02.176117 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:02.176080 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0aeac5_14b3_4eb0_8021_d90674b5f11f.slice/crio-0d14ce79f536cef006c1d9b993cabd63a261dc3e89af13b95a14d90831a78288 WatchSource:0}: Error finding container 0d14ce79f536cef006c1d9b993cabd63a261dc3e89af13b95a14d90831a78288: Status 404 returned error can't find the container with id 0d14ce79f536cef006c1d9b993cabd63a261dc3e89af13b95a14d90831a78288 Jul 29 15:03:02.183295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.183257 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn"] Jul 29 15:03:02.186157 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:02.186133 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95c2cef_ea07_4830_9f70_3514c154f70f.slice/crio-36797536817e04a882cf5b6000467a3a753dad9ad78ebd652ce9a8e636093e06 WatchSource:0}: Error finding container 36797536817e04a882cf5b6000467a3a753dad9ad78ebd652ce9a8e636093e06: Status 404 returned error can't find the container with id 36797536817e04a882cf5b6000467a3a753dad9ad78ebd652ce9a8e636093e06 Jul 29 15:03:02.214952 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:02.214924 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7cb694_b81c_43ee_b71b_3c047f4803e2.slice/crio-0764408e7c0f5703d2812de973329e18c71edbafa53a345512f0df30b39b8bbb WatchSource:0}: Error finding container 0764408e7c0f5703d2812de973329e18c71edbafa53a345512f0df30b39b8bbb: Status 404 returned error can't find the container with id 0764408e7c0f5703d2812de973329e18c71edbafa53a345512f0df30b39b8bbb Jul 29 15:03:02.261383 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.261357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bvlql" event={"ID":"735f57de-b8ff-4c41-a20b-7007fe890fbb","Type":"ContainerStarted","Data":"5c3400e0c78bd8b5a6fbc8e913f8b78e812a94c80bb86484eda2072f1f1a9ebf"} Jul 29 15:03:02.262541 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.262517 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" event={"ID":"3d0aeac5-14b3-4eb0-8021-d90674b5f11f","Type":"ContainerStarted","Data":"0d14ce79f536cef006c1d9b993cabd63a261dc3e89af13b95a14d90831a78288"} Jul 29 15:03:02.263908 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.263886 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" event={"ID":"1e7cb694-b81c-43ee-b71b-3c047f4803e2","Type":"ContainerStarted","Data":"0764408e7c0f5703d2812de973329e18c71edbafa53a345512f0df30b39b8bbb"} Jul 29 15:03:02.265003 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.264979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" event={"ID":"a95c2cef-ea07-4830-9f70-3514c154f70f","Type":"ContainerStarted","Data":"36797536817e04a882cf5b6000467a3a753dad9ad78ebd652ce9a8e636093e06"} Jul 29 15:03:02.266158 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.266135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xz8gp" event={"ID":"50137084-5fe9-4bf1-945b-d727d3006c81","Type":"ContainerStarted","Data":"e5b39fc8fe01e100c5a8d44eee1c816bd3944fa3e3df4e0cc83b329a107cda71"} Jul 29 15:03:02.276886 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:02.276858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd4598459-lgjmp"] Jul 29 15:03:03.276752 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.276508 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" event={"ID":"1e7cb694-b81c-43ee-b71b-3c047f4803e2","Type":"ContainerStarted","Data":"e890b77dfee752bbdeac3921587952578effbc4d673db940c7433b0040140888"} Jul 29 15:03:03.278009 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.277971 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:03.327983 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.326709 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" podStartSLOduration=2.32668773 podStartE2EDuration="2.32668773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:03.325024811 +0000 UTC m=+79.786515308" watchObservedRunningTime="2026-07-29 15:03:03.32668773 +0000 UTC m=+79.788178226" Jul 29 15:03:03.718104 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.718069 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:03.721245 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.721214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.724408 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.724385 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gv9nd\"" Jul 29 15:03:03.725120 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.724895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:03:03.725262 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.725159 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:03:03.725262 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.725216 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:03:03.725386 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.725257 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:03:03.728446 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.728290 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:03:03.738423 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.738137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:03.788525 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.788525 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.788525 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5mj\" (UniqueName: \"kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.788835 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.788835 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788625 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.788835 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.788665 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.889871 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889827 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5mj\" (UniqueName: \"kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.889976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890679 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.890629 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890871 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.890846 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.890951 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.890907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.892836 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.892811 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.892930 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.892897 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:03.902928 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:03.902866 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5mj\" (UniqueName: \"kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj\") pod \"console-6f8f9d744b-tjz2m\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:04.034467 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:04.034401 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:04.258609 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:04.258578 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:04.262490 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:04.262457 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79bc579_56b3_48ef_a5b7_e3ed72e05560.slice/crio-07b0c5282ee423336233175e24ccfc8e7a2f764028e38aff604a478ab4382ce2 WatchSource:0}: Error finding container 07b0c5282ee423336233175e24ccfc8e7a2f764028e38aff604a478ab4382ce2: Status 404 returned error can't find the container with id 07b0c5282ee423336233175e24ccfc8e7a2f764028e38aff604a478ab4382ce2 Jul 29 15:03:04.282714 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:04.282673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8f9d744b-tjz2m" event={"ID":"e79bc579-56b3-48ef-a5b7-e3ed72e05560","Type":"ContainerStarted","Data":"07b0c5282ee423336233175e24ccfc8e7a2f764028e38aff604a478ab4382ce2"} Jul 29 15:03:04.286330 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:04.285922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" event={"ID":"a95c2cef-ea07-4830-9f70-3514c154f70f","Type":"ContainerStarted","Data":"a9080d713938be28835d42112174362583564a3758792629ad227cfec80c4113"} Jul 29 15:03:04.320508 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:04.319823 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kdzfn" podStartSLOduration=2.026966321 podStartE2EDuration="3.319798747s" totalImagesPullingTime="1.292832426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:04.317186139 +0000 UTC m=+80.778676636" watchObservedRunningTime="2026-07-29 15:03:04.319798747 +0000 UTC m=+80.781289243" Jul 29 15:03:07.747114 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.746986 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qxsml"] Jul 29 15:03:07.756321 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.756291 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.763085 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.762775 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:03:07.763085 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.762819 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 15:03:07.763085 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.762877 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:03:07.763361 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.763178 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gbhdw\"" Jul 29 15:03:07.763361 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.763215 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:03:07.763463 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.763433 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 15:03:07.784830 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.784744 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qxsml"] Jul 29 15:03:07.825052 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.825005 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.825234 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.825092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9aec634-3963-443e-8bad-c2f37107a73b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.825234 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.825137 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rj7\" (UniqueName: \"kubernetes.io/projected/a9aec634-3963-443e-8bad-c2f37107a73b-kube-api-access-67rj7\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.825234 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.825166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.926763 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.926090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9aec634-3963-443e-8bad-c2f37107a73b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.926763 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.926151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rj7\" (UniqueName: \"kubernetes.io/projected/a9aec634-3963-443e-8bad-c2f37107a73b-kube-api-access-67rj7\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.926763 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.926186 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.926763 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.926268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.927469 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.927412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9aec634-3963-443e-8bad-c2f37107a73b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.929180 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.929128 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.929289 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.929262 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9aec634-3963-443e-8bad-c2f37107a73b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:07.938812 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:07.938753 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rj7\" (UniqueName: \"kubernetes.io/projected/a9aec634-3963-443e-8bad-c2f37107a73b-kube-api-access-67rj7\") pod \"prometheus-operator-84d69f794d-qxsml\" (UID: \"a9aec634-3963-443e-8bad-c2f37107a73b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:08.077905 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:08.077865 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" Jul 29 15:03:09.522336 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:09.522252 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qxsml"] Jul 29 15:03:10.258478 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:10.258445 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d6jxv" Jul 29 15:03:10.663885 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:10.663840 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9aec634_3963_443e_8bad_c2f37107a73b.slice/crio-60eb41393cd2c0a00b5807bc7b67a03e4925ae526d79c0a6ced2615abc1aba94 WatchSource:0}: Error finding container 60eb41393cd2c0a00b5807bc7b67a03e4925ae526d79c0a6ced2615abc1aba94: Status 404 returned error can't find the container with id 60eb41393cd2c0a00b5807bc7b67a03e4925ae526d79c0a6ced2615abc1aba94 Jul 29 15:03:11.320905 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.320699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" event={"ID":"a9aec634-3963-443e-8bad-c2f37107a73b","Type":"ContainerStarted","Data":"60eb41393cd2c0a00b5807bc7b67a03e4925ae526d79c0a6ced2615abc1aba94"} Jul 29 15:03:11.322795 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.322760 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8f9d744b-tjz2m" event={"ID":"e79bc579-56b3-48ef-a5b7-e3ed72e05560","Type":"ContainerStarted","Data":"5f51ec2fbf8d81eaf4668a737e3feffeb170e95d2b2e9f58adfe6da84fe58020"} Jul 29 15:03:11.325281 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.325257 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bvlql" event={"ID":"735f57de-b8ff-4c41-a20b-7007fe890fbb","Type":"ContainerStarted","Data":"55752990aad39eb9cbb65ab8bb349363488cebf790f5d1179bb455fb10e24248"} Jul 29 15:03:11.327414 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.327388 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" event={"ID":"3d0aeac5-14b3-4eb0-8021-d90674b5f11f","Type":"ContainerStarted","Data":"a78fd0641897da62965a42fdaf56d325a1191bb5f6aa69acbfafaf18a858045d"} Jul 29 15:03:11.327575 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.327553 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:11.329380 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.329336 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" Jul 29 15:03:11.345262 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.344864 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f8f9d744b-tjz2m" podStartSLOduration=1.8889167279999999 podStartE2EDuration="8.344845425s" totalImagesPullingTime="6.455928697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.344349147 +0000 UTC m=+87.805839633" watchObservedRunningTime="2026-07-29 15:03:11.344845425 +0000 UTC m=+87.806335919" Jul 29 15:03:11.372669 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.372599 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bvlql" podStartSLOduration=18.629577009 podStartE2EDuration="38.372576873s" totalImagesPullingTime="19.742999864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:02:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.370806226 +0000 UTC m=+87.832296721" watchObservedRunningTime="2026-07-29 15:03:11.372576873 +0000 UTC m=+87.834067372" Jul 29 15:03:11.387344 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.387283 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9bf8d6d76-rc9dp" podStartSLOduration=1.856008812 podStartE2EDuration="10.387265257s" totalImagesPullingTime="8.531256445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.38605157 +0000 UTC m=+87.847542079" watchObservedRunningTime="2026-07-29 15:03:11.387265257 +0000 UTC m=+87.848755730" Jul 29 15:03:11.470519 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.470487 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:03:11.681426 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.681345 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:11.684772 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.684737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.693539 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.693064 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:03:11.702577 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.702526 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:11.763398 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763408 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763433 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbxf\" (UniqueName: \"kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763460 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763498 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763589 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.763876 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.763627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864701 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864663 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864922 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864922 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864767 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864922 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbxf\" (UniqueName: \"kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864922 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.864922 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.865165 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.864945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.865538 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.865500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.865832 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.865799 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.866083 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.866063 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.866351 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.866331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.868007 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.867960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.868196 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.868169 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.875006 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.874979 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbxf\" (UniqueName: \"kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf\") pod \"console-57776df5cf-n6zqh\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:11.997229 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:11.997151 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:12.535417 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:12.535390 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:12.544783 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:12.544745 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf583ce61_5002_4016_9695_e79821294232.slice/crio-c92a79ece1ce964fd3dbb8e0d1ea3e7aa9ba4d004492c8d818ce3ba1f569f26a WatchSource:0}: Error finding container c92a79ece1ce964fd3dbb8e0d1ea3e7aa9ba4d004492c8d818ce3ba1f569f26a: Status 404 returned error can't find the container with id c92a79ece1ce964fd3dbb8e0d1ea3e7aa9ba4d004492c8d818ce3ba1f569f26a Jul 29 15:03:13.340450 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:13.340356 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57776df5cf-n6zqh" event={"ID":"f583ce61-5002-4016-9695-e79821294232","Type":"ContainerStarted","Data":"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6"} Jul 29 15:03:13.340957 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:13.340459 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57776df5cf-n6zqh" event={"ID":"f583ce61-5002-4016-9695-e79821294232","Type":"ContainerStarted","Data":"c92a79ece1ce964fd3dbb8e0d1ea3e7aa9ba4d004492c8d818ce3ba1f569f26a"} Jul 29 15:03:13.342489 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:13.342457 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" event={"ID":"a9aec634-3963-443e-8bad-c2f37107a73b","Type":"ContainerStarted","Data":"94981322c99287678ae215efbf2b3b0d94b194fe7b445e7c0b733e3042c5bc04"} Jul 29 15:03:13.342637 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:13.342513 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" event={"ID":"a9aec634-3963-443e-8bad-c2f37107a73b","Type":"ContainerStarted","Data":"9fd4a0d559e6cc1a4c2c208e61d683a87f290490e06494ee8f65336ac035a432"} Jul 29 15:03:13.397882 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:13.397813 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57776df5cf-n6zqh" podStartSLOduration=2.397790287 podStartE2EDuration="2.397790287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:13.397154446 +0000 UTC m=+89.858644943" watchObservedRunningTime="2026-07-29 15:03:13.397790287 +0000 UTC m=+89.859280784" Jul 29 15:03:14.035559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:14.035519 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:14.035770 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:14.035582 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:14.041125 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:14.041094 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:14.080051 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:14.079994 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-qxsml" podStartSLOduration=5.314428781 podStartE2EDuration="7.079973625s" totalImagesPullingTime="1.765544844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:13.506646656 +0000 UTC m=+89.968137151" watchObservedRunningTime="2026-07-29 15:03:14.079973625 +0000 UTC m=+90.541464124" Jul 29 15:03:14.351591 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:14.351518 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:16.259189 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.259152 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5nmdj"] Jul 29 15:03:16.416073 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.416039 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.428328 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.428280 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:03:16.428328 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.428280 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:03:16.428528 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.428360 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:03:16.443188 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.443159 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-55kk8\"" Jul 29 15:03:16.510343 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-wtmp\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510343 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-sys\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkd27\" (UniqueName: \"kubernetes.io/projected/d346dc6f-17e6-4a74-b96c-d1b283d01961-kube-api-access-vkd27\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-metrics-client-ca\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510420 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-textfile\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-root\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-tls\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.510820 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.510583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611276 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-root\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611276 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-tls\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-wtmp\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-root\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-sys\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkd27\" (UniqueName: \"kubernetes.io/projected/d346dc6f-17e6-4a74-b96c-d1b283d01961-kube-api-access-vkd27\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611486 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-metrics-client-ca\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-textfile\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.611532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.611523 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-wtmp\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.612057 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.612028 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-textfile\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.612057 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.612047 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d346dc6f-17e6-4a74-b96c-d1b283d01961-sys\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.612229 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.612063 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.612514 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.612488 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d346dc6f-17e6-4a74-b96c-d1b283d01961-metrics-client-ca\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.614006 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.613984 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-tls\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.614229 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.614207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d346dc6f-17e6-4a74-b96c-d1b283d01961-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.654109 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.654076 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkd27\" (UniqueName: \"kubernetes.io/projected/d346dc6f-17e6-4a74-b96c-d1b283d01961-kube-api-access-vkd27\") pod \"node-exporter-5nmdj\" (UID: \"d346dc6f-17e6-4a74-b96c-d1b283d01961\") " pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:16.727535 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:16.727498 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nmdj" Jul 29 15:03:20.180303 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.180262 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99"] Jul 29 15:03:20.357332 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.357269 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99"] Jul 29 15:03:20.357332 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.357317 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cd56fd977-g55vv"] Jul 29 15:03:20.357587 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.357407 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.364484 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.364460 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 15:03:20.371438 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.371414 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z7xt7\"" Jul 29 15:03:20.374327 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.374302 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cd56fd977-g55vv"] Jul 29 15:03:20.374436 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.374413 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.382372 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.382327 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 15:03:20.383129 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.383107 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 15:03:20.383293 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.383246 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 15:03:20.383645 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.383488 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jwns5\"" Jul 29 15:03:20.383645 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.383600 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 15:03:20.383950 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.383933 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 15:03:20.384141 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.384122 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1au7hachv5tns\"" Jul 29 15:03:20.553873 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.553836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac0f7491-5611-47ca-a0ba-79c581a542d6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.554070 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.553893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554070 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.553938 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554070 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.553967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554070 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554266 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-grpc-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554266 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xwz6\" (UniqueName: \"kubernetes.io/projected/22ce06f4-07c1-46c1-a486-8e6a301eefa8-kube-api-access-9xwz6\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554266 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554207 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.554358 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhkx\" (UniqueName: \"kubernetes.io/projected/ac0f7491-5611-47ca-a0ba-79c581a542d6-kube-api-access-blhkx\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.554358 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.554293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ce06f4-07c1-46c1-a486-8e6a301eefa8-metrics-client-ca\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.654768 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654733 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac0f7491-5611-47ca-a0ba-79c581a542d6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.654768 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654785 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655013 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655013 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655013 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654874 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655013 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.654922 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-grpc-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.655128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xwz6\" (UniqueName: \"kubernetes.io/projected/22ce06f4-07c1-46c1-a486-8e6a301eefa8-kube-api-access-9xwz6\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.655181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.655560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.655241 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhkx\" (UniqueName: \"kubernetes.io/projected/ac0f7491-5611-47ca-a0ba-79c581a542d6-kube-api-access-blhkx\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.655560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.655278 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ce06f4-07c1-46c1-a486-8e6a301eefa8-metrics-client-ca\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.656219 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.656158 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ce06f4-07c1-46c1-a486-8e6a301eefa8-metrics-client-ca\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.657995 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.657967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.658304 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.658285 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.658403 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.658383 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac0f7491-5611-47ca-a0ba-79c581a542d6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.658889 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.658857 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.659146 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.659121 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-grpc-tls\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.659350 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.659327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.659979 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.659955 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22ce06f4-07c1-46c1-a486-8e6a301eefa8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.671757 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.671708 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhkx\" (UniqueName: \"kubernetes.io/projected/ac0f7491-5611-47ca-a0ba-79c581a542d6-kube-api-access-blhkx\") pod \"monitoring-plugin-68b7fc9574-fvc99\" (UID: \"ac0f7491-5611-47ca-a0ba-79c581a542d6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:20.676073 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.676049 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xwz6\" (UniqueName: \"kubernetes.io/projected/22ce06f4-07c1-46c1-a486-8e6a301eefa8-kube-api-access-9xwz6\") pod \"thanos-querier-cd56fd977-g55vv\" (UID: \"22ce06f4-07c1-46c1-a486-8e6a301eefa8\") " pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.686843 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.686815 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:20.720332 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:20.720289 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd346dc6f_17e6_4a74_b96c_d1b283d01961.slice/crio-219a2b15d1d6a4e5b90fe7fec013c789130ce58a5f601fde6624009b2675c31b WatchSource:0}: Error finding container 219a2b15d1d6a4e5b90fe7fec013c789130ce58a5f601fde6624009b2675c31b: Status 404 returned error can't find the container with id 219a2b15d1d6a4e5b90fe7fec013c789130ce58a5f601fde6624009b2675c31b Jul 29 15:03:20.744093 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.744059 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:20.857910 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.857830 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cd56fd977-g55vv"] Jul 29 15:03:20.861256 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:20.861225 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ce06f4_07c1_46c1_a486_8e6a301eefa8.slice/crio-7f1bfbf53da0ee1969af3b76fa37c6af7472b509644ad3cd560d3a3a5d41d1bc WatchSource:0}: Error finding container 7f1bfbf53da0ee1969af3b76fa37c6af7472b509644ad3cd560d3a3a5d41d1bc: Status 404 returned error can't find the container with id 7f1bfbf53da0ee1969af3b76fa37c6af7472b509644ad3cd560d3a3a5d41d1bc Jul 29 15:03:20.971319 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:20.971289 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:21.198205 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.198178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99"] Jul 29 15:03:21.201233 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:03:21.201193 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0f7491_5611_47ca_a0ba_79c581a542d6.slice/crio-89d38889cc3d9e9887a27efdeffdea015c59ecb9b7a50e11a015a12d1b47c526 WatchSource:0}: Error finding container 89d38889cc3d9e9887a27efdeffdea015c59ecb9b7a50e11a015a12d1b47c526: Status 404 returned error can't find the container with id 89d38889cc3d9e9887a27efdeffdea015c59ecb9b7a50e11a015a12d1b47c526 Jul 29 15:03:21.375978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.375884 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nmdj" event={"ID":"d346dc6f-17e6-4a74-b96c-d1b283d01961","Type":"ContainerStarted","Data":"219a2b15d1d6a4e5b90fe7fec013c789130ce58a5f601fde6624009b2675c31b"} Jul 29 15:03:21.377338 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.377312 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" event={"ID":"ac0f7491-5611-47ca-a0ba-79c581a542d6","Type":"ContainerStarted","Data":"89d38889cc3d9e9887a27efdeffdea015c59ecb9b7a50e11a015a12d1b47c526"} Jul 29 15:03:21.379000 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.378967 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xz8gp" event={"ID":"50137084-5fe9-4bf1-945b-d727d3006c81","Type":"ContainerStarted","Data":"c9d51b264da1b400b9bf81151e2702b68bf2fa5a3a294194f6426217464ecda4"} Jul 29 15:03:21.379224 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.379208 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:21.380628 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.380599 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"7f1bfbf53da0ee1969af3b76fa37c6af7472b509644ad3cd560d3a3a5d41d1bc"} Jul 29 15:03:21.380817 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.380794 2583 patch_prober.go:28] interesting pod/downloads-7c97dc4555-xz8gp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jul 29 15:03:21.380939 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.380839 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-xz8gp" podUID="50137084-5fe9-4bf1-945b-d727d3006c81" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jul 29 15:03:21.997770 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:21.997701 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:22.402293 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:22.402256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-xz8gp" Jul 29 15:03:22.437289 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:22.435717 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-xz8gp" podStartSLOduration=2.469028615 podStartE2EDuration="21.435695298s" totalImagesPullingTime="18.966666683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:21.4111693 +0000 UTC m=+97.872659798" watchObservedRunningTime="2026-07-29 15:03:22.435695298 +0000 UTC m=+98.897185797" Jul 29 15:03:23.393201 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.393100 2583 generic.go:356] "Generic (PLEG): container finished" podID="d346dc6f-17e6-4a74-b96c-d1b283d01961" containerID="e482a7d162d9e0dfcd8ba4ac561e1eb6d1a8be26460f8d40eadd496534985669" exitCode=0 Jul 29 15:03:23.393503 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.393213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nmdj" event={"ID":"d346dc6f-17e6-4a74-b96c-d1b283d01961","Type":"ContainerDied","Data":"e482a7d162d9e0dfcd8ba4ac561e1eb6d1a8be26460f8d40eadd496534985669"} Jul 29 15:03:23.397118 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.396939 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" event={"ID":"ac0f7491-5611-47ca-a0ba-79c581a542d6","Type":"ContainerStarted","Data":"148fe729996069f774d8b073dbed0bd828be98349dde359c6521fcbf1fa70ad8"} Jul 29 15:03:23.397118 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.397075 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:23.403758 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.403622 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" Jul 29 15:03:23.451805 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:23.451172 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-fvc99" podStartSLOduration=1.491309444 podStartE2EDuration="3.451148619s" totalImagesPullingTime="1.959839175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:23.450018849 +0000 UTC m=+99.911509359" watchObservedRunningTime="2026-07-29 15:03:23.451148619 +0000 UTC m=+99.912639118" Jul 29 15:03:24.291602 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:24.291567 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bd4598459-lgjmp" Jul 29 15:03:24.404702 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:24.404588 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nmdj" event={"ID":"d346dc6f-17e6-4a74-b96c-d1b283d01961","Type":"ContainerStarted","Data":"4ab31a80daa92ba43788a60306a9c0b18057b1d931faa6366ad691c823b702e7"} Jul 29 15:03:24.404702 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:24.404653 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nmdj" event={"ID":"d346dc6f-17e6-4a74-b96c-d1b283d01961","Type":"ContainerStarted","Data":"2e22fc00129c254fed9bfedeeead1fb4da9552d2ae503da573234217f6fcc7a7"} Jul 29 15:03:25.410493 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:25.410447 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"79f892ae166c9ae40e39a09c898ac17e969c89fde9d5a4c36d835bbf1fe0316d"} Jul 29 15:03:26.418863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:26.418627 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"dec4aa145d8cd87730b79dbb070bdf4c38cc18ca926f0d1365d4b5bd50a39cb7"} Jul 29 15:03:26.418863 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:26.418715 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"f374fa3730ffe3496adcc8bed11ae6a2128b90f4c753015ce7650477d24211c7"} Jul 29 15:03:26.487679 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:26.487623 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerName="registry" containerID="cri-o://1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a" gracePeriod=30 Jul 29 15:03:27.013575 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.013539 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:03:27.047269 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.047200 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5nmdj" podStartSLOduration=8.752427845 podStartE2EDuration="11.047137658s" totalImagesPullingTime="2.193184167s" totalInitContainerRuntime="101.525646ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:24.449472795 +0000 UTC m=+100.910963291" watchObservedRunningTime="2026-07-29 15:03:27.047137658 +0000 UTC m=+103.508628154" Jul 29 15:03:27.121397 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121313 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.121397 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121376 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.121719 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121684 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.121872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121760 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.121872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121784 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:27.121872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121799 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7hzv\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.121872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121837 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.122086 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121880 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.122086 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.121924 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates\") pod \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\" (UID: \"d49e1bc7-a48d-491d-85ac-2d346172bf3c\") " Jul 29 15:03:27.122195 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.122171 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-trusted-ca\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.123034 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.122514 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:27.124898 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.124847 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:03:27.125410 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.125357 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:27.125553 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.125434 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv" (OuterVolumeSpecName: "kube-api-access-l7hzv") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "kube-api-access-l7hzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:03:27.125711 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.125686 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:27.126124 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.126104 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:03:27.135024 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.134942 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d49e1bc7-a48d-491d-85ac-2d346172bf3c" (UID: "d49e1bc7-a48d-491d-85ac-2d346172bf3c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:03:27.223380 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223338 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d49e1bc7-a48d-491d-85ac-2d346172bf3c-ca-trust-extracted\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223380 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223379 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-tls\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223581 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223392 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-image-registry-private-configuration\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223581 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223404 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7hzv\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-kube-api-access-l7hzv\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223581 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223413 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d49e1bc7-a48d-491d-85ac-2d346172bf3c-installation-pull-secrets\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223581 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223422 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d49e1bc7-a48d-491d-85ac-2d346172bf3c-bound-sa-token\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.223581 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.223430 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d49e1bc7-a48d-491d-85ac-2d346172bf3c-registry-certificates\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:27.424767 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.424707 2583 generic.go:356] "Generic (PLEG): container finished" podID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerID="1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a" exitCode=0 Jul 29 15:03:27.425166 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.424769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" event={"ID":"d49e1bc7-a48d-491d-85ac-2d346172bf3c","Type":"ContainerDied","Data":"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a"} Jul 29 15:03:27.425166 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.424795 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" Jul 29 15:03:27.425166 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.424833 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6669c7db5c-tkfw7" event={"ID":"d49e1bc7-a48d-491d-85ac-2d346172bf3c","Type":"ContainerDied","Data":"3992b1b57758f718814f833633b3a27197e4f086c058af05e185ce0e9d36c18f"} Jul 29 15:03:27.425166 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.424864 2583 scope.go:117] "RemoveContainer" containerID="1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a" Jul 29 15:03:27.428943 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.428906 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"b83874107b056591ace465db603c12d1551d54f36c4635b3adf107d1e1d70ee5"} Jul 29 15:03:27.436139 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.436116 2583 scope.go:117] "RemoveContainer" containerID="1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a" Jul 29 15:03:27.436454 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:03:27.436425 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a\": container with ID starting with 1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a not found: ID does not exist" containerID="1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a" Jul 29 15:03:27.436526 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.436462 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a"} err="failed to get container status \"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a\": rpc error: code = NotFound desc = could not find container \"1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a\": container with ID starting with 1be6bd6496f096d9a42075357b5fd9507eb85f9cec3f341096922a2689f46c1a not found: ID does not exist" Jul 29 15:03:27.454752 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.452079 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:03:27.457882 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.457849 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6669c7db5c-tkfw7"] Jul 29 15:03:27.974373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:27.974298 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" path="/var/lib/kubelet/pods/d49e1bc7-a48d-491d-85ac-2d346172bf3c/volumes" Jul 29 15:03:28.438402 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:28.438365 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"8f1b1d1f8aa7ebb92a7b3b952cf5019b0fc6c0adcce2b2492493a19a4628a5ab"} Jul 29 15:03:28.438899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:28.438438 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" event={"ID":"22ce06f4-07c1-46c1-a486-8e6a301eefa8","Type":"ContainerStarted","Data":"461f4eafe1c236f0847b8d4b3809b6483ad940d8c2be12fd9b0384fefd66dd4f"} Jul 29 15:03:28.438899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:28.438581 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:28.485783 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:28.485703 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" podStartSLOduration=2.465643674 podStartE2EDuration="8.485681243s" totalImagesPullingTime="6.020037569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:28.483890828 +0000 UTC m=+104.945381329" watchObservedRunningTime="2026-07-29 15:03:28.485681243 +0000 UTC m=+104.947171739" Jul 29 15:03:30.254338 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:30.254308 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xcfdp" Jul 29 15:03:31.309745 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:31.309700 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:34.448920 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:34.448887 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cd56fd977-g55vv" Jul 29 15:03:45.767000 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:45.766933 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57776df5cf-n6zqh" podUID="f583ce61-5002-4016-9695-e79821294232" containerName="console" containerID="cri-o://11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6" gracePeriod=15 Jul 29 15:03:46.051230 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.051201 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:46.179927 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.179894 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.179927 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.179936 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.179956 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nbxf\" (UniqueName: \"kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.179996 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180038 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180061 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180085 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle\") pod \"f583ce61-5002-4016-9695-e79821294232\" (UID: \"f583ce61-5002-4016-9695-e79821294232\") " Jul 29 15:03:46.180438 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180381 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca" (OuterVolumeSpecName: "service-ca") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:46.180547 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180516 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:46.180623 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180593 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config" (OuterVolumeSpecName: "console-config") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:46.180623 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.180614 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:46.182279 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.182252 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf" (OuterVolumeSpecName: "kube-api-access-5nbxf") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "kube-api-access-5nbxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:03:46.182598 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.182579 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:46.182655 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.182605 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f583ce61-5002-4016-9695-e79821294232" (UID: "f583ce61-5002-4016-9695-e79821294232"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280821 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-trusted-ca-bundle\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280853 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-console-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280867 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-service-ca\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280878 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nbxf\" (UniqueName: \"kubernetes.io/projected/f583ce61-5002-4016-9695-e79821294232-kube-api-access-5nbxf\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280891 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f583ce61-5002-4016-9695-e79821294232-oauth-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280906 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-oauth-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.280913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.280918 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f583ce61-5002-4016-9695-e79821294232-console-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:46.507584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.507548 2583 generic.go:356] "Generic (PLEG): container finished" podID="f583ce61-5002-4016-9695-e79821294232" containerID="11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6" exitCode=0 Jul 29 15:03:46.507762 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.507591 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57776df5cf-n6zqh" Jul 29 15:03:46.507762 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.507637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57776df5cf-n6zqh" event={"ID":"f583ce61-5002-4016-9695-e79821294232","Type":"ContainerDied","Data":"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6"} Jul 29 15:03:46.507762 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.507681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57776df5cf-n6zqh" event={"ID":"f583ce61-5002-4016-9695-e79821294232","Type":"ContainerDied","Data":"c92a79ece1ce964fd3dbb8e0d1ea3e7aa9ba4d004492c8d818ce3ba1f569f26a"} Jul 29 15:03:46.507762 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.507700 2583 scope.go:117] "RemoveContainer" containerID="11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6" Jul 29 15:03:46.516159 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.516141 2583 scope.go:117] "RemoveContainer" containerID="11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6" Jul 29 15:03:46.516414 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:03:46.516396 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6\": container with ID starting with 11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6 not found: ID does not exist" containerID="11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6" Jul 29 15:03:46.516465 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.516424 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6"} err="failed to get container status \"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6\": rpc error: code = NotFound desc = could not find container \"11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6\": container with ID starting with 11e5dd38a9ba659b50299694f89d32646c48a9b82c49587d235c7a25befc45a6 not found: ID does not exist" Jul 29 15:03:46.530047 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.530024 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:46.533943 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:46.533886 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57776df5cf-n6zqh"] Jul 29 15:03:47.972435 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:47.972388 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f583ce61-5002-4016-9695-e79821294232" path="/var/lib/kubelet/pods/f583ce61-5002-4016-9695-e79821294232/volumes" Jul 29 15:03:56.328113 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.328049 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f8f9d744b-tjz2m" podUID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" containerName="console" containerID="cri-o://5f51ec2fbf8d81eaf4668a737e3feffeb170e95d2b2e9f58adfe6da84fe58020" gracePeriod=15 Jul 29 15:03:56.545133 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.545094 2583 generic.go:356] "Generic (PLEG): container finished" podID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" containerID="5f51ec2fbf8d81eaf4668a737e3feffeb170e95d2b2e9f58adfe6da84fe58020" exitCode=0 Jul 29 15:03:56.545297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.545148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8f9d744b-tjz2m" event={"ID":"e79bc579-56b3-48ef-a5b7-e3ed72e05560","Type":"ContainerDied","Data":"5f51ec2fbf8d81eaf4668a737e3feffeb170e95d2b2e9f58adfe6da84fe58020"} Jul 29 15:03:56.636129 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.636096 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:56.771522 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771489 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.771704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771537 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr5mj\" (UniqueName: \"kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.771704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771567 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.771704 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771678 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.771919 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771715 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.771919 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771766 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca\") pod \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\" (UID: \"e79bc579-56b3-48ef-a5b7-e3ed72e05560\") " Jul 29 15:03:56.772025 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.771982 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:56.772025 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.772007 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config" (OuterVolumeSpecName: "console-config") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:56.772250 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.772228 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca" (OuterVolumeSpecName: "service-ca") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:03:56.773869 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.773841 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:56.773966 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.773923 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj" (OuterVolumeSpecName: "kube-api-access-zr5mj") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "kube-api-access-zr5mj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:03:56.774038 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.773993 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e79bc579-56b3-48ef-a5b7-e3ed72e05560" (UID: "e79bc579-56b3-48ef-a5b7-e3ed72e05560"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872881 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-oauth-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872914 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872924 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-service-ca\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872932 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-console-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872941 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr5mj\" (UniqueName: \"kubernetes.io/projected/e79bc579-56b3-48ef-a5b7-e3ed72e05560-kube-api-access-zr5mj\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:56.872978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:56.872949 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79bc579-56b3-48ef-a5b7-e3ed72e05560-oauth-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:03:57.555029 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.554994 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8f9d744b-tjz2m" event={"ID":"e79bc579-56b3-48ef-a5b7-e3ed72e05560","Type":"ContainerDied","Data":"07b0c5282ee423336233175e24ccfc8e7a2f764028e38aff604a478ab4382ce2"} Jul 29 15:03:57.555029 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.555033 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8f9d744b-tjz2m" Jul 29 15:03:57.555548 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.555084 2583 scope.go:117] "RemoveContainer" containerID="5f51ec2fbf8d81eaf4668a737e3feffeb170e95d2b2e9f58adfe6da84fe58020" Jul 29 15:03:57.605297 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.605266 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:57.614662 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.614639 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f8f9d744b-tjz2m"] Jul 29 15:03:57.972513 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:03:57.972435 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" path="/var/lib/kubelet/pods/e79bc579-56b3-48ef-a5b7-e3ed72e05560/volumes" Jul 29 15:04:02.574371 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:04:02.574338 2583 generic.go:356] "Generic (PLEG): container finished" podID="6a5cc648-ad7f-4049-b0e4-8d7dfd0009da" containerID="ac7a138d58ee0c4d336f6c52d78a599704dfd969bf3942d270b5713276bb5c6e" exitCode=0 Jul 29 15:04:02.574828 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:04:02.574425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" event={"ID":"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da","Type":"ContainerDied","Data":"ac7a138d58ee0c4d336f6c52d78a599704dfd969bf3942d270b5713276bb5c6e"} Jul 29 15:04:02.574828 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:04:02.574794 2583 scope.go:117] "RemoveContainer" containerID="ac7a138d58ee0c4d336f6c52d78a599704dfd969bf3942d270b5713276bb5c6e" Jul 29 15:04:03.579964 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:04:03.579931 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm" event={"ID":"6a5cc648-ad7f-4049-b0e4-8d7dfd0009da","Type":"ContainerStarted","Data":"0b78869dd2f77c74c3f54ed4353faf5b63ef8a06c1164188951f5b9b276fcbfb"} Jul 29 15:06:43.873785 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:06:43.873754 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:06:43.878531 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:06:43.878502 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:06:43.880850 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:06:43.880834 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:08:30.135110 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135074 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135353 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135364 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135375 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerName="registry" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135381 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerName="registry" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135390 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f583ce61-5002-4016-9695-e79821294232" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135396 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f583ce61-5002-4016-9695-e79821294232" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135450 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e79bc579-56b3-48ef-a5b7-e3ed72e05560" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135456 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f583ce61-5002-4016-9695-e79821294232" containerName="console" Jul 29 15:08:30.135543 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.135462 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49e1bc7-a48d-491d-85ac-2d346172bf3c" containerName="registry" Jul 29 15:08:30.137511 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.137486 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.140079 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.140044 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gv9nd\"" Jul 29 15:08:30.140907 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.140879 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:08:30.141434 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.141229 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:08:30.141434 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.141262 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:08:30.141434 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.141301 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:08:30.141820 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.141234 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:08:30.146480 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.146459 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:08:30.150979 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.150954 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:08:30.243807 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.243769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtln4\" (UniqueName: \"kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.243986 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.243814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.243986 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.243858 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.243986 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.243916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.243986 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.243958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.244133 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.244010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.244133 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.244053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345257 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345466 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345312 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345466 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345545 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345619 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtln4\" (UniqueName: \"kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345687 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.345834 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.345807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.346183 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.346163 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.346274 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.346254 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.346353 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.346329 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.346574 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.346551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.347913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.347890 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.348007 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.347933 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.354265 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.354243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtln4\" (UniqueName: \"kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4\") pod \"console-7dd56fbb58-ztt29\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.451412 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.451320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:30.580664 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:30.580639 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:08:30.583325 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:08:30.583280 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee4c122_2946_459d_910f_fd76409213d8.slice/crio-c62eaacd6fc5985d41ab813a3099ba52c23fe53f2f21de4d2174aa56980493f1 WatchSource:0}: Error finding container c62eaacd6fc5985d41ab813a3099ba52c23fe53f2f21de4d2174aa56980493f1: Status 404 returned error can't find the container with id c62eaacd6fc5985d41ab813a3099ba52c23fe53f2f21de4d2174aa56980493f1 Jul 29 15:08:31.524560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:31.524514 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd56fbb58-ztt29" event={"ID":"5ee4c122-2946-459d-910f-fd76409213d8","Type":"ContainerStarted","Data":"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d"} Jul 29 15:08:31.524560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:31.524563 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd56fbb58-ztt29" event={"ID":"5ee4c122-2946-459d-910f-fd76409213d8","Type":"ContainerStarted","Data":"c62eaacd6fc5985d41ab813a3099ba52c23fe53f2f21de4d2174aa56980493f1"} Jul 29 15:08:31.548196 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:31.548145 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd56fbb58-ztt29" podStartSLOduration=1.548126831 podStartE2EDuration="1.548126831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:08:31.546216961 +0000 UTC m=+408.007707456" watchObservedRunningTime="2026-07-29 15:08:31.548126831 +0000 UTC m=+408.009617329" Jul 29 15:08:40.452087 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:40.452043 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:40.452087 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:40.452097 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:40.456668 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:40.456639 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:08:40.560260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:08:40.560233 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:09:54.781618 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.781580 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:09:54.783940 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.783920 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.797001 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.796976 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:09:54.913811 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.913769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.913989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.913858 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.913989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.913918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.913989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.913955 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.913989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.913975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.914122 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.914041 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6sw\" (UniqueName: \"kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:54.914122 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:54.914069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014582 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014544 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6sw\" (UniqueName: \"kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014624 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014704 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.014786 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.014745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.015477 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.015442 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.015617 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.015592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.015684 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.015617 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.015772 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.015688 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.017237 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.017207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.017324 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.017265 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.025675 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.025654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6sw\" (UniqueName: \"kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw\") pod \"console-b8c9dfc4f-4rhmq\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.093022 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.092934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:09:55.221789 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.221749 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:09:55.224712 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:09:55.224682 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d66b197_e686_4287_891f_8a67d86e1671.slice/crio-f973743e9527870842bb931fd9cad78d20e2213945c5dab71ba08e9aa55efa54 WatchSource:0}: Error finding container f973743e9527870842bb931fd9cad78d20e2213945c5dab71ba08e9aa55efa54: Status 404 returned error can't find the container with id f973743e9527870842bb931fd9cad78d20e2213945c5dab71ba08e9aa55efa54 Jul 29 15:09:55.821254 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.821219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9dfc4f-4rhmq" event={"ID":"6d66b197-e686-4287-891f-8a67d86e1671","Type":"ContainerStarted","Data":"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317"} Jul 29 15:09:55.821632 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.821265 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9dfc4f-4rhmq" event={"ID":"6d66b197-e686-4287-891f-8a67d86e1671","Type":"ContainerStarted","Data":"f973743e9527870842bb931fd9cad78d20e2213945c5dab71ba08e9aa55efa54"} Jul 29 15:09:55.839822 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:09:55.839765 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8c9dfc4f-4rhmq" podStartSLOduration=1.839746315 podStartE2EDuration="1.839746315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:55.838761665 +0000 UTC m=+492.300252162" watchObservedRunningTime="2026-07-29 15:09:55.839746315 +0000 UTC m=+492.301236802" Jul 29 15:10:05.093684 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:05.093650 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:10:05.094186 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:05.093742 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:10:05.098485 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:05.098461 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:10:05.863197 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:05.863161 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:10:05.954048 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:05.954016 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:10:30.973448 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:30.973387 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dd56fbb58-ztt29" podUID="5ee4c122-2946-459d-910f-fd76409213d8" containerName="console" containerID="cri-o://194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d" gracePeriod=15 Jul 29 15:10:31.216265 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.216242 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:10:31.310622 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310597 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.310825 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310632 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.310825 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310669 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.310825 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310695 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtln4\" (UniqueName: \"kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.310825 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310742 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.310825 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310774 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.311048 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.310904 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert\") pod \"5ee4c122-2946-459d-910f-fd76409213d8\" (UID: \"5ee4c122-2946-459d-910f-fd76409213d8\") " Jul 29 15:10:31.311206 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.311156 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:31.311206 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.311157 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config" (OuterVolumeSpecName: "console-config") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:31.311369 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.311225 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:31.311453 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.311427 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:31.312949 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.312925 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4" (OuterVolumeSpecName: "kube-api-access-rtln4") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "kube-api-access-rtln4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:10:31.313380 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.313361 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:10:31.313452 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.313376 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ee4c122-2946-459d-910f-fd76409213d8" (UID: "5ee4c122-2946-459d-910f-fd76409213d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:10:31.411899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411860 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-oauth-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.411899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411889 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee4c122-2946-459d-910f-fd76409213d8-console-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.411899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411899 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-oauth-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.411899 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411908 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-console-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.412155 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411918 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-trusted-ca-bundle\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.412155 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411925 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4c122-2946-459d-910f-fd76409213d8-service-ca\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.412155 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.411934 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtln4\" (UniqueName: \"kubernetes.io/projected/5ee4c122-2946-459d-910f-fd76409213d8-kube-api-access-rtln4\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:10:31.957362 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.957326 2583 generic.go:356] "Generic (PLEG): container finished" podID="5ee4c122-2946-459d-910f-fd76409213d8" containerID="194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d" exitCode=0 Jul 29 15:10:31.957523 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.957372 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd56fbb58-ztt29" Jul 29 15:10:31.957523 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.957414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd56fbb58-ztt29" event={"ID":"5ee4c122-2946-459d-910f-fd76409213d8","Type":"ContainerDied","Data":"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d"} Jul 29 15:10:31.957523 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.957466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd56fbb58-ztt29" event={"ID":"5ee4c122-2946-459d-910f-fd76409213d8","Type":"ContainerDied","Data":"c62eaacd6fc5985d41ab813a3099ba52c23fe53f2f21de4d2174aa56980493f1"} Jul 29 15:10:31.957523 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.957493 2583 scope.go:117] "RemoveContainer" containerID="194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d" Jul 29 15:10:31.966491 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.966423 2583 scope.go:117] "RemoveContainer" containerID="194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d" Jul 29 15:10:31.966737 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:10:31.966704 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d\": container with ID starting with 194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d not found: ID does not exist" containerID="194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d" Jul 29 15:10:31.966895 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.966868 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d"} err="failed to get container status \"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d\": rpc error: code = NotFound desc = could not find container \"194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d\": container with ID starting with 194d29171ffb295bc72521c473c83e0335737718eb3dca054eb6ea79d3954c8d not found: ID does not exist" Jul 29 15:10:31.982608 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.982584 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:10:31.987855 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:31.987834 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd56fbb58-ztt29"] Jul 29 15:10:33.972327 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:10:33.972293 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee4c122-2946-459d-910f-fd76409213d8" path="/var/lib/kubelet/pods/5ee4c122-2946-459d-910f-fd76409213d8/volumes" Jul 29 15:11:33.837437 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.837402 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq"] Jul 29 15:11:33.837889 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.837697 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee4c122-2946-459d-910f-fd76409213d8" containerName="console" Jul 29 15:11:33.837889 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.837709 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee4c122-2946-459d-910f-fd76409213d8" containerName="console" Jul 29 15:11:33.837889 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.837792 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee4c122-2946-459d-910f-fd76409213d8" containerName="console" Jul 29 15:11:33.839872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.839854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.843118 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.843100 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 15:11:33.843830 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.843806 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d2mfw\"" Jul 29 15:11:33.843830 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.843817 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 15:11:33.851606 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.851582 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq"] Jul 29 15:11:33.896741 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.896694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd4cj\" (UniqueName: \"kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.896923 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.896763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.896923 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.896859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.998074 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.998039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.998215 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.998099 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd4cj\" (UniqueName: \"kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.998215 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.998137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.998526 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.998502 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:33.998563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:33.998502 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:34.006702 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:34.006678 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd4cj\" (UniqueName: \"kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:34.148187 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:34.148108 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:34.278858 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:34.278827 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq"] Jul 29 15:11:34.281909 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:11:34.281863 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bcadbc_fe21_4626_8bfe_4886aab5bdb4.slice/crio-3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a WatchSource:0}: Error finding container 3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a: Status 404 returned error can't find the container with id 3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a Jul 29 15:11:34.284028 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:34.284012 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:11:35.189980 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:35.189946 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerStarted","Data":"3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a"} Jul 29 15:11:41.213873 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:41.213833 2583 generic.go:356] "Generic (PLEG): container finished" podID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerID="1062789163a0001b1da2b33e4925acd57398027f70cbd8a7a997fe81b7848ff0" exitCode=0 Jul 29 15:11:41.214253 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:41.213922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerDied","Data":"1062789163a0001b1da2b33e4925acd57398027f70cbd8a7a997fe81b7848ff0"} Jul 29 15:11:43.899552 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:43.899520 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:11:43.901150 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:43.901124 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:11:44.227614 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:44.227578 2583 generic.go:356] "Generic (PLEG): container finished" podID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerID="1386851bb869ad273f04db37442a05ca1fd9889c815e6d7f9b25c6151dfb9b47" exitCode=0 Jul 29 15:11:44.227799 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:44.227635 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerDied","Data":"1386851bb869ad273f04db37442a05ca1fd9889c815e6d7f9b25c6151dfb9b47"} Jul 29 15:11:51.261227 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:51.261187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerStarted","Data":"91eb6dabb364cc5580813075f41378beaf9dacb6499b76f78b7ba1a54fa83a9d"} Jul 29 15:11:51.299395 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:51.299348 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" podStartSLOduration=2.764446061 podStartE2EDuration="18.29933067s" totalImagesPullingTime="15.534884609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:11:51.298934354 +0000 UTC m=+607.760424850" watchObservedRunningTime="2026-07-29 15:11:51.29933067 +0000 UTC m=+607.760821167" Jul 29 15:11:52.266682 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:52.266650 2583 generic.go:356] "Generic (PLEG): container finished" podID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerID="91eb6dabb364cc5580813075f41378beaf9dacb6499b76f78b7ba1a54fa83a9d" exitCode=0 Jul 29 15:11:52.267059 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:52.266750 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerDied","Data":"91eb6dabb364cc5580813075f41378beaf9dacb6499b76f78b7ba1a54fa83a9d"} Jul 29 15:11:53.394092 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.394067 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:53.466777 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.466747 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle\") pod \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " Jul 29 15:11:53.466777 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.466789 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util\") pod \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " Jul 29 15:11:53.466980 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.466842 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd4cj\" (UniqueName: \"kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj\") pod \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\" (UID: \"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4\") " Jul 29 15:11:53.467405 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.467376 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle" (OuterVolumeSpecName: "bundle") pod "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" (UID: "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:11:53.469001 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.468973 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj" (OuterVolumeSpecName: "kube-api-access-zd4cj") pod "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" (UID: "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4"). InnerVolumeSpecName "kube-api-access-zd4cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:11:53.473697 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.473656 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util" (OuterVolumeSpecName: "util") pod "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" (UID: "a3bcadbc-fe21-4626-8bfe-4886aab5bdb4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:11:53.567516 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.567435 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd4cj\" (UniqueName: \"kubernetes.io/projected/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-kube-api-access-zd4cj\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:11:53.567516 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.567460 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-bundle\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:11:53.567516 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:53.567469 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bcadbc-fe21-4626-8bfe-4886aab5bdb4-util\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:11:54.276926 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:54.276900 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" Jul 29 15:11:54.276926 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:54.276919 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b57rkrq" event={"ID":"a3bcadbc-fe21-4626-8bfe-4886aab5bdb4","Type":"ContainerDied","Data":"3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a"} Jul 29 15:11:54.277126 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:54.276960 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a58cc7c903665fbd430a6efc00fb1c65bc41395d40232c11961f88161bd7b3a" Jul 29 15:11:56.261301 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261266 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz"] Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261537 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="extract" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261547 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="extract" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261563 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="util" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261569 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="util" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261576 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="pull" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261581 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="pull" Jul 29 15:11:56.261693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.261628 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bcadbc-fe21-4626-8bfe-4886aab5bdb4" containerName="extract" Jul 29 15:11:56.294256 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.294225 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz"] Jul 29 15:11:56.294404 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.294338 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.297072 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.297040 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 15:11:56.297072 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.297074 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 15:11:56.297260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.297054 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-47jvq\"" Jul 29 15:11:56.297260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.297177 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 15:11:56.389099 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.389062 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtc2\" (UniqueName: \"kubernetes.io/projected/2e3dfab0-314f-4b9d-8671-7532ee07ec03-kube-api-access-2dtc2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.389099 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.389108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2e3dfab0-314f-4b9d-8671-7532ee07ec03-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.489953 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.489924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtc2\" (UniqueName: \"kubernetes.io/projected/2e3dfab0-314f-4b9d-8671-7532ee07ec03-kube-api-access-2dtc2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.490097 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.489968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2e3dfab0-314f-4b9d-8671-7532ee07ec03-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.492347 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.492314 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2e3dfab0-314f-4b9d-8671-7532ee07ec03-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.498507 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.498482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtc2\" (UniqueName: \"kubernetes.io/projected/2e3dfab0-314f-4b9d-8671-7532ee07ec03-kube-api-access-2dtc2\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz\" (UID: \"2e3dfab0-314f-4b9d-8671-7532ee07ec03\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.604479 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.604439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:11:56.753215 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:56.753178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz"] Jul 29 15:11:56.756133 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:11:56.756095 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3dfab0_314f_4b9d_8671_7532ee07ec03.slice/crio-776c9697a031ee8d538772b8ffda072aa324101975fafe42e8f7b3b7a6eefeda WatchSource:0}: Error finding container 776c9697a031ee8d538772b8ffda072aa324101975fafe42e8f7b3b7a6eefeda: Status 404 returned error can't find the container with id 776c9697a031ee8d538772b8ffda072aa324101975fafe42e8f7b3b7a6eefeda Jul 29 15:11:57.289960 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:11:57.289926 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" event={"ID":"2e3dfab0-314f-4b9d-8671-7532ee07ec03","Type":"ContainerStarted","Data":"776c9697a031ee8d538772b8ffda072aa324101975fafe42e8f7b3b7a6eefeda"} Jul 29 15:12:00.305061 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.305023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" event={"ID":"2e3dfab0-314f-4b9d-8671-7532ee07ec03","Type":"ContainerStarted","Data":"1644ad8eed0c1b546ee963772b7308b8e6acfa9af363956262c8389c70585d52"} Jul 29 15:12:00.305440 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.305136 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:12:00.325944 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.325034 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" podStartSLOduration=0.871675482 podStartE2EDuration="4.325013959s" totalImagesPullingTime="3.453338477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:00.324476424 +0000 UTC m=+616.785966919" watchObservedRunningTime="2026-07-29 15:12:00.325013959 +0000 UTC m=+616.786504456" Jul 29 15:12:00.949903 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.949867 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-xsj55"] Jul 29 15:12:00.952037 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.952021 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:00.956447 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.956426 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 15:12:00.957037 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.956981 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-qbgxv\"" Jul 29 15:12:00.957146 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.957107 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 15:12:00.969067 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:00.966442 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-xsj55"] Jul 29 15:12:01.027000 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.026952 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/91e8559f-dec9-46e5-9043-bc6384170776-cabundle0\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.027159 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.027008 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.027159 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.027125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrnwn\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-kube-api-access-vrnwn\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.128069 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.128029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/91e8559f-dec9-46e5-9043-bc6384170776-cabundle0\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.128069 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.128067 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.128090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrnwn\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-kube-api-access-vrnwn\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:12:01.128174 2583 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:12:01.128200 2583 secret.go:281] references non-existent secret key: ca.crt Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:12:01.128208 2583 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:12:01.128221 2583 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-xsj55: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 15:12:01.128334 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:12:01.128285 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates podName:91e8559f-dec9-46e5-9043-bc6384170776 nodeName:}" failed. No retries permitted until 2026-07-29 15:12:01.628268022 +0000 UTC m=+618.089758515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates") pod "keda-operator-77f648d694-xsj55" (UID: "91e8559f-dec9-46e5-9043-bc6384170776") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 15:12:01.128667 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.128647 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/91e8559f-dec9-46e5-9043-bc6384170776-cabundle0\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.141607 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.141573 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrnwn\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-kube-api-access-vrnwn\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.564740 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.564690 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5"] Jul 29 15:12:01.567090 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.567074 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.581161 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.581141 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 15:12:01.595416 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.595395 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5"] Jul 29 15:12:01.633707 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.633675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.633880 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.633716 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8ad508f8-4a52-4d54-91e3-096334fe6ee4-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.633880 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.633781 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-certificates\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.633880 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.633811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwgg6\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-kube-api-access-kwgg6\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.636169 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.636147 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91e8559f-dec9-46e5-9043-bc6384170776-certificates\") pod \"keda-operator-77f648d694-xsj55\" (UID: \"91e8559f-dec9-46e5-9043-bc6384170776\") " pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.734290 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.734251 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwgg6\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-kube-api-access-kwgg6\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.734458 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.734346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8ad508f8-4a52-4d54-91e3-096334fe6ee4-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.734458 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.734370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-certificates\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.734855 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.734836 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8ad508f8-4a52-4d54-91e3-096334fe6ee4-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.736876 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.736858 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-certificates\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.744531 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.744502 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwgg6\" (UniqueName: \"kubernetes.io/projected/8ad508f8-4a52-4d54-91e3-096334fe6ee4-kube-api-access-kwgg6\") pod \"keda-metrics-apiserver-55557df8c-6mgc5\" (UID: \"8ad508f8-4a52-4d54-91e3-096334fe6ee4\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:01.862913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.861861 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:01.878008 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:01.877962 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:02.050892 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:02.050858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-xsj55"] Jul 29 15:12:02.053327 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:12:02.053302 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e8559f_dec9_46e5_9043_bc6384170776.slice/crio-07da607c95d79cc6c565e65f5d435e1a667cdd2296f1534386d9604034965085 WatchSource:0}: Error finding container 07da607c95d79cc6c565e65f5d435e1a667cdd2296f1534386d9604034965085: Status 404 returned error can't find the container with id 07da607c95d79cc6c565e65f5d435e1a667cdd2296f1534386d9604034965085 Jul 29 15:12:02.058945 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:02.058907 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5"] Jul 29 15:12:02.062194 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:12:02.062167 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad508f8_4a52_4d54_91e3_096334fe6ee4.slice/crio-5eb630dc7fb715adebc2f598161f2cbce2baa0731edb315124f8f82895d0070a WatchSource:0}: Error finding container 5eb630dc7fb715adebc2f598161f2cbce2baa0731edb315124f8f82895d0070a: Status 404 returned error can't find the container with id 5eb630dc7fb715adebc2f598161f2cbce2baa0731edb315124f8f82895d0070a Jul 29 15:12:02.315405 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:02.315364 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-xsj55" event={"ID":"91e8559f-dec9-46e5-9043-bc6384170776","Type":"ContainerStarted","Data":"07da607c95d79cc6c565e65f5d435e1a667cdd2296f1534386d9604034965085"} Jul 29 15:12:02.316649 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:02.316626 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" event={"ID":"8ad508f8-4a52-4d54-91e3-096334fe6ee4","Type":"ContainerStarted","Data":"5eb630dc7fb715adebc2f598161f2cbce2baa0731edb315124f8f82895d0070a"} Jul 29 15:12:06.342226 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.342183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-xsj55" event={"ID":"91e8559f-dec9-46e5-9043-bc6384170776","Type":"ContainerStarted","Data":"a16c9eb4229662424f18bf3d5a545a342ed3fb50246920d96abb1af6c380ad3b"} Jul 29 15:12:06.342693 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.342282 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:12:06.343769 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.343713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" event={"ID":"8ad508f8-4a52-4d54-91e3-096334fe6ee4","Type":"ContainerStarted","Data":"4bf335a0867b6bd49ca788e357db207e30c5b4592d5169ec0fedb5998e23fcc0"} Jul 29 15:12:06.343889 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.343786 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:06.359919 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.359874 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-xsj55" podStartSLOduration=2.249728092 podStartE2EDuration="6.359860394s" totalImagesPullingTime="4.110132302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:06.357929521 +0000 UTC m=+622.819420016" watchObservedRunningTime="2026-07-29 15:12:06.359860394 +0000 UTC m=+622.821350889" Jul 29 15:12:06.380163 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:06.380101 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" podStartSLOduration=1.279282397 podStartE2EDuration="5.380078442s" totalImagesPullingTime="4.100796045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:12:06.378618953 +0000 UTC m=+622.840109450" watchObservedRunningTime="2026-07-29 15:12:06.380078442 +0000 UTC m=+622.841568940" Jul 29 15:12:17.353579 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:17.353547 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-6mgc5" Jul 29 15:12:21.312000 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:21.311972 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-gmlqz" Jul 29 15:12:27.351041 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:12:27.351006 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-xsj55" Jul 29 15:13:08.132010 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.131971 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6f77c7fb78-jcmhc"] Jul 29 15:13:08.137934 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.137903 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.140485 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.140462 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 15:13:08.141476 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.141453 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-wn52k\"" Jul 29 15:13:08.141586 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.141497 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 15:13:08.141586 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.141521 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 29 15:13:08.143037 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.143018 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-k5t6r"] Jul 29 15:13:08.145875 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.145656 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f77c7fb78-jcmhc"] Jul 29 15:13:08.145875 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.145784 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.148241 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.148218 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 15:13:08.148367 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.148243 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-bpfsm\"" Jul 29 15:13:08.156955 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.156929 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-k5t6r"] Jul 29 15:13:08.279399 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.279360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd55s\" (UniqueName: \"kubernetes.io/projected/3b3b4073-10f8-48fd-896d-52d7ae765f2f-kube-api-access-sd55s\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.279584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.279445 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20247be9-8144-455c-a3fc-7fe273c5ef88-cert\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.279584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.279463 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22s8d\" (UniqueName: \"kubernetes.io/projected/20247be9-8144-455c-a3fc-7fe273c5ef88-kube-api-access-22s8d\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.279584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.279491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b3b4073-10f8-48fd-896d-52d7ae765f2f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.380801 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.380746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd55s\" (UniqueName: \"kubernetes.io/projected/3b3b4073-10f8-48fd-896d-52d7ae765f2f-kube-api-access-sd55s\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.381005 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.380863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20247be9-8144-455c-a3fc-7fe273c5ef88-cert\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.381005 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.380889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22s8d\" (UniqueName: \"kubernetes.io/projected/20247be9-8144-455c-a3fc-7fe273c5ef88-kube-api-access-22s8d\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.381005 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.380913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b3b4073-10f8-48fd-896d-52d7ae765f2f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.383473 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.383412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b3b4073-10f8-48fd-896d-52d7ae765f2f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.383647 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.383626 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20247be9-8144-455c-a3fc-7fe273c5ef88-cert\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.396333 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.396298 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd55s\" (UniqueName: \"kubernetes.io/projected/3b3b4073-10f8-48fd-896d-52d7ae765f2f-kube-api-access-sd55s\") pod \"llmisvc-controller-manager-67d95fdc48-k5t6r\" (UID: \"3b3b4073-10f8-48fd-896d-52d7ae765f2f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.398565 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.398542 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22s8d\" (UniqueName: \"kubernetes.io/projected/20247be9-8144-455c-a3fc-7fe273c5ef88-kube-api-access-22s8d\") pod \"kserve-controller-manager-6f77c7fb78-jcmhc\" (UID: \"20247be9-8144-455c-a3fc-7fe273c5ef88\") " pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.449882 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.449843 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:08.459015 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.458993 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:08.600830 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.600794 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f77c7fb78-jcmhc"] Jul 29 15:13:08.606097 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:13:08.606064 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20247be9_8144_455c_a3fc_7fe273c5ef88.slice/crio-b9ca9d1d79fb32daf6e7a16a9b80d2ab36c9a6183b23e3c072fe3e4697beb4f8 WatchSource:0}: Error finding container b9ca9d1d79fb32daf6e7a16a9b80d2ab36c9a6183b23e3c072fe3e4697beb4f8: Status 404 returned error can't find the container with id b9ca9d1d79fb32daf6e7a16a9b80d2ab36c9a6183b23e3c072fe3e4697beb4f8 Jul 29 15:13:08.621881 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:08.621858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-k5t6r"] Jul 29 15:13:08.624714 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:13:08.624687 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b3b4073_10f8_48fd_896d_52d7ae765f2f.slice/crio-a79b04b204914c0bb99a940bdb8e72544903d51343c8d3ee20b9d9ca24c99cc0 WatchSource:0}: Error finding container a79b04b204914c0bb99a940bdb8e72544903d51343c8d3ee20b9d9ca24c99cc0: Status 404 returned error can't find the container with id a79b04b204914c0bb99a940bdb8e72544903d51343c8d3ee20b9d9ca24c99cc0 Jul 29 15:13:09.609371 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:09.609325 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" event={"ID":"20247be9-8144-455c-a3fc-7fe273c5ef88","Type":"ContainerStarted","Data":"b9ca9d1d79fb32daf6e7a16a9b80d2ab36c9a6183b23e3c072fe3e4697beb4f8"} Jul 29 15:13:09.611264 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:09.611219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"a79b04b204914c0bb99a940bdb8e72544903d51343c8d3ee20b9d9ca24c99cc0"} Jul 29 15:13:12.625248 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.625207 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" event={"ID":"20247be9-8144-455c-a3fc-7fe273c5ef88","Type":"ContainerStarted","Data":"e875422f6f235efe3a46190c723ad4cd7b49ce8800132c69e1fe760415738e18"} Jul 29 15:13:12.625716 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.625362 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:12.626671 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.626648 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"2a028e8835d7e01310663f994f183ff0ec20951ea97dd8da22f8a92bffe85984"} Jul 29 15:13:12.626803 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.626696 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:12.645038 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.644983 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" podStartSLOduration=1.328832647 podStartE2EDuration="4.644969169s" totalImagesPullingTime="3.316136522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:12.6434036 +0000 UTC m=+689.104894095" watchObservedRunningTime="2026-07-29 15:13:12.644969169 +0000 UTC m=+689.106459665" Jul 29 15:13:12.661050 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:12.660999 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podStartSLOduration=1.405966236 podStartE2EDuration="4.660983166s" totalImagesPullingTime="3.25501693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:12.660229763 +0000 UTC m=+689.121720263" watchObservedRunningTime="2026-07-29 15:13:12.660983166 +0000 UTC m=+689.122473662" Jul 29 15:13:13.632227 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:13.632187 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="2a028e8835d7e01310663f994f183ff0ec20951ea97dd8da22f8a92bffe85984" exitCode=1 Jul 29 15:13:13.632742 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:13.632281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"2a028e8835d7e01310663f994f183ff0ec20951ea97dd8da22f8a92bffe85984"} Jul 29 15:13:13.632742 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:13.632505 2583 scope.go:117] "RemoveContainer" containerID="2a028e8835d7e01310663f994f183ff0ec20951ea97dd8da22f8a92bffe85984" Jul 29 15:13:14.638800 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:14.638766 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18"} Jul 29 15:13:14.639203 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:14.638873 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:15.644940 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:15.644903 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" exitCode=1 Jul 29 15:13:15.645389 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:15.644947 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18"} Jul 29 15:13:15.645389 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:15.644995 2583 scope.go:117] "RemoveContainer" containerID="2a028e8835d7e01310663f994f183ff0ec20951ea97dd8da22f8a92bffe85984" Jul 29 15:13:15.645389 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:15.645238 2583 scope.go:117] "RemoveContainer" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" Jul 29 15:13:15.645561 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:15.645480 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:16.651356 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:16.651327 2583 scope.go:117] "RemoveContainer" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" Jul 29 15:13:16.651866 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:16.651490 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:18.459821 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:18.459785 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:18.460192 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:18.460177 2583 scope.go:117] "RemoveContainer" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" Jul 29 15:13:18.460367 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:18.460349 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:30.968804 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:30.968769 2583 scope.go:117] "RemoveContainer" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" Jul 29 15:13:31.466041 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.465998 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5897b98d59-sgtnn"] Jul 29 15:13:31.469529 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.469506 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.482355 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.482326 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5897b98d59-sgtnn"] Jul 29 15:13:31.567109 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-trusted-ca-bundle\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-console-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-oauth-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrkv\" (UniqueName: \"kubernetes.io/projected/9f38023a-48d3-4927-811c-db1caecb5c18-kube-api-access-gsrkv\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567295 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-service-ca\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567459 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.567459 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.567351 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-oauth-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668555 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668514 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-oauth-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668555 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-trusted-ca-bundle\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668586 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-console-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-oauth-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrkv\" (UniqueName: \"kubernetes.io/projected/9f38023a-48d3-4927-811c-db1caecb5c18-kube-api-access-gsrkv\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-service-ca\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.668854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.668677 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.669438 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.669405 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-oauth-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.669563 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.669407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-console-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.669629 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.669597 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-service-ca\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.669673 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.669634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f38023a-48d3-4927-811c-db1caecb5c18-trusted-ca-bundle\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.671618 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.671599 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-serving-cert\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.671758 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.671738 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f38023a-48d3-4927-811c-db1caecb5c18-console-oauth-config\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.677788 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.677767 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrkv\" (UniqueName: \"kubernetes.io/projected/9f38023a-48d3-4927-811c-db1caecb5c18-kube-api-access-gsrkv\") pod \"console-5897b98d59-sgtnn\" (UID: \"9f38023a-48d3-4927-811c-db1caecb5c18\") " pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.715584 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.715545 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89"} Jul 29 15:13:31.715930 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.715910 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:31.778895 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.778863 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:31.915598 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:31.915564 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5897b98d59-sgtnn"] Jul 29 15:13:31.918470 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:13:31.918438 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f38023a_48d3_4927_811c_db1caecb5c18.slice/crio-d79d9cfa21f2f46ebc9d9e350688fd9dae78ac7c7413ff7c63c37e9b08a323c2 WatchSource:0}: Error finding container d79d9cfa21f2f46ebc9d9e350688fd9dae78ac7c7413ff7c63c37e9b08a323c2: Status 404 returned error can't find the container with id d79d9cfa21f2f46ebc9d9e350688fd9dae78ac7c7413ff7c63c37e9b08a323c2 Jul 29 15:13:32.721048 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.721008 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5897b98d59-sgtnn" event={"ID":"9f38023a-48d3-4927-811c-db1caecb5c18","Type":"ContainerStarted","Data":"51af1e13af2a9affdf0999dcd747b338586e42cef5bbdec3b6afa624ac365719"} Jul 29 15:13:32.721499 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.721068 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5897b98d59-sgtnn" event={"ID":"9f38023a-48d3-4927-811c-db1caecb5c18","Type":"ContainerStarted","Data":"d79d9cfa21f2f46ebc9d9e350688fd9dae78ac7c7413ff7c63c37e9b08a323c2"} Jul 29 15:13:32.722827 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.722803 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" exitCode=1 Jul 29 15:13:32.722944 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.722845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89"} Jul 29 15:13:32.722944 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.722897 2583 scope.go:117] "RemoveContainer" containerID="cc7db81d2af552c3b80b6878f574c1b2830f650286cbb2ddc1bfcc36e7f3ba18" Jul 29 15:13:32.723048 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.723030 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:13:32.723232 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:32.723208 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:32.738997 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:32.738953 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5897b98d59-sgtnn" podStartSLOduration=1.73893725 podStartE2EDuration="1.73893725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:32.737223885 +0000 UTC m=+709.198714380" watchObservedRunningTime="2026-07-29 15:13:32.73893725 +0000 UTC m=+709.200427746" Jul 29 15:13:33.729363 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:33.729330 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:13:33.729759 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:33.729479 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:38.460100 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:38.459988 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:13:38.460487 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:38.460383 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:13:38.460580 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:38.460560 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:13:41.779504 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:41.779449 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:41.780021 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:41.779526 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:41.784454 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:41.784430 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:42.769397 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:42.769370 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5897b98d59-sgtnn" Jul 29 15:13:42.820294 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:42.820260 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:13:43.638095 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:43.638058 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6f77c7fb78-jcmhc" Jul 29 15:13:48.968784 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:13:48.968753 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:13:48.969176 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:13:48.968946 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:00.969003 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:00.968974 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:14:01.849790 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:01.849755 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846"} Jul 29 15:14:01.849990 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:01.849973 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:14:02.855689 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:02.855655 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" exitCode=1 Jul 29 15:14:02.856182 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:02.855755 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846"} Jul 29 15:14:02.856182 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:02.855845 2583 scope.go:117] "RemoveContainer" containerID="1202e59d377d9c452110a843311e68312bc3a5185171a4ca4eaae24edcb15a89" Jul 29 15:14:02.856182 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:02.856061 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:02.856314 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:02.856292 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:03.862362 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:03.862336 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:03.862767 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:03.862505 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:07.840901 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:07.840857 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b8c9dfc4f-4rhmq" podUID="6d66b197-e686-4287-891f-8a67d86e1671" containerName="console" containerID="cri-o://feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317" gracePeriod=15 Jul 29 15:14:08.085903 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.085867 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:14:08.175312 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175216 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175312 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175266 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb6sw\" (UniqueName: \"kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175312 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175295 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175347 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175378 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175411 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175456 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca\") pod \"6d66b197-e686-4287-891f-8a67d86e1671\" (UID: \"6d66b197-e686-4287-891f-8a67d86e1671\") " Jul 29 15:14:08.175915 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175868 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config" (OuterVolumeSpecName: "console-config") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:14:08.175915 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175890 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:14:08.175915 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175904 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:14:08.176072 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.175911 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:14:08.177531 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.177505 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:14:08.177661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.177534 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw" (OuterVolumeSpecName: "kube-api-access-wb6sw") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "kube-api-access-wb6sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:14:08.177661 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.177648 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d66b197-e686-4287-891f-8a67d86e1671" (UID: "6d66b197-e686-4287-891f-8a67d86e1671"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:14:08.276260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276217 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-oauth-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276255 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-service-ca\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276260 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276268 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-oauth-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276499 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276282 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb6sw\" (UniqueName: \"kubernetes.io/projected/6d66b197-e686-4287-891f-8a67d86e1671-kube-api-access-wb6sw\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276499 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276294 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d66b197-e686-4287-891f-8a67d86e1671-console-serving-cert\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276499 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276304 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-trusted-ca-bundle\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.276499 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.276316 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d66b197-e686-4287-891f-8a67d86e1671-console-config\") on node \"ip-10-0-135-6.ec2.internal\" DevicePath \"\"" Jul 29 15:14:08.459887 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.459798 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:14:08.460217 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.460203 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:08.460381 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:08.460363 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:08.884172 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.884134 2583 generic.go:356] "Generic (PLEG): container finished" podID="6d66b197-e686-4287-891f-8a67d86e1671" containerID="feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317" exitCode=0 Jul 29 15:14:08.884172 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.884171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9dfc4f-4rhmq" event={"ID":"6d66b197-e686-4287-891f-8a67d86e1671","Type":"ContainerDied","Data":"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317"} Jul 29 15:14:08.884715 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.884181 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c9dfc4f-4rhmq" Jul 29 15:14:08.884715 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.884206 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c9dfc4f-4rhmq" event={"ID":"6d66b197-e686-4287-891f-8a67d86e1671","Type":"ContainerDied","Data":"f973743e9527870842bb931fd9cad78d20e2213945c5dab71ba08e9aa55efa54"} Jul 29 15:14:08.884715 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.884226 2583 scope.go:117] "RemoveContainer" containerID="feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317" Jul 29 15:14:08.893419 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.893394 2583 scope.go:117] "RemoveContainer" containerID="feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317" Jul 29 15:14:08.893683 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:08.893661 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317\": container with ID starting with feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317 not found: ID does not exist" containerID="feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317" Jul 29 15:14:08.893756 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.893692 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317"} err="failed to get container status \"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317\": rpc error: code = NotFound desc = could not find container \"feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317\": container with ID starting with feaac1fe65ae72393d120f0fe93d71a1e4d391af1be53ec91a5f94657c3fa317 not found: ID does not exist" Jul 29 15:14:08.907256 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.907224 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:14:08.910802 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:08.910775 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8c9dfc4f-4rhmq"] Jul 29 15:14:09.974120 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:09.974086 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d66b197-e686-4287-891f-8a67d86e1671" path="/var/lib/kubelet/pods/6d66b197-e686-4287-891f-8a67d86e1671/volumes" Jul 29 15:14:19.968445 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:19.968407 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:19.969031 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:19.968644 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:32.968622 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:32.968583 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:32.969137 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:32.968823 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:45.968949 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:45.968913 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:47.050611 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:47.050576 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e"} Jul 29 15:14:47.051037 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:47.050816 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:14:48.056125 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:48.056087 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" exitCode=1 Jul 29 15:14:48.056560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:48.056166 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e"} Jul 29 15:14:48.056560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:48.056221 2583 scope.go:117] "RemoveContainer" containerID="cabfe9c3ea8101eec52a11c4ffea384bc11252e06b0b4eaf2a8178e1e774b846" Jul 29 15:14:48.056560 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:48.056357 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:14:48.056678 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:48.056570 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:48.459657 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:48.459574 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:14:49.062037 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:49.062010 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:14:49.062403 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:49.062175 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:14:50.066435 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:14:50.066402 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:14:50.066937 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:14:50.066601 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:15:03.970746 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:15:03.970700 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:15:03.971219 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:15:03.970880 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:15:15.968509 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:15:15.968426 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:15:15.968920 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:15:15.968607 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:15:29.968242 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:15:29.968210 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:15:29.968621 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:15:29.968399 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:15:41.968365 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:15:41.968335 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:15:41.968838 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:15:41.968526 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:15:52.968423 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:15:52.968381 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:15:52.968953 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:15:52.968594 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:04.968642 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:04.968609 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:16:04.969062 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:04.968824 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:15.968701 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:15.968663 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:16:16.440814 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:16.440779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerStarted","Data":"4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de"} Jul 29 15:16:16.441050 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:16.441029 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:16:17.448894 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:17.448809 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" exitCode=1 Jul 29 15:16:17.449326 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:17.448898 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de"} Jul 29 15:16:17.449326 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:17.448959 2583 scope.go:117] "RemoveContainer" containerID="8b757b164109f489163ff1d63d390fb9af21d89e6cf83bca45a7b26bd11b253e" Jul 29 15:16:17.449326 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:17.449080 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:17.449326 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:17.449297 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:18.456121 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:18.456091 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:18.456517 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:18.456280 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:18.459156 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:18.459140 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:16:19.460464 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:19.460436 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:19.460861 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:19.460596 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:31.973331 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:31.973306 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:31.973765 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:31.973476 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:43.932757 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:43.932167 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:16:43.937244 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:43.937216 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:16:45.968486 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:45.968453 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:45.968895 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:45.968645 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:16:57.968940 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:16:57.968903 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:16:57.969411 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:16:57.969057 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:17:08.968580 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:17:08.968548 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:17:08.969026 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:17:08.968764 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:17:23.970376 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:17:23.970346 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:17:23.970787 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:17:23.970520 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:17:34.968361 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:17:34.968328 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:17:34.970672 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:17:34.968502 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:17:49.969094 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:17:49.969060 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:17:49.969494 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:17:49.969227 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:18:02.968891 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:18:02.968858 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:18:02.969279 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:18:02.969038 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:18:17.969027 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:18:17.968944 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:18:17.969498 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:18:17.969165 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:18:30.968074 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:18:30.968039 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:18:30.968470 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:18:30.968210 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:18:41.973258 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:18:41.973232 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:18:41.973628 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:18:41.973415 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:18:52.968421 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:18:52.968385 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:18:52.968930 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:18:52.968594 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:07.968807 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:07.968775 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:19:07.969287 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:07.969084 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:19:09.173880 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:09.173851 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" exitCode=1 Jul 29 15:19:09.174285 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:09.173920 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" event={"ID":"3b3b4073-10f8-48fd-896d-52d7ae765f2f","Type":"ContainerDied","Data":"3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c"} Jul 29 15:19:09.174285 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:09.173986 2583 scope.go:117] "RemoveContainer" containerID="4b26fffc47dbd3862723d3c5a8bf01a5b06ec3ca9b47e1e543d3907513c406de" Jul 29 15:19:09.174373 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:09.174293 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:09.174489 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:09.174469 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:11.441570 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:11.441516 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:19:11.441994 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:11.441899 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:11.442091 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:11.442072 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:18.460159 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:18.460127 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" Jul 29 15:19:18.460559 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:18.460460 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:18.460679 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:18.460658 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:28.968924 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:28.968889 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:28.969398 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:28.969052 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:39.969005 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:39.968972 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:39.969394 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:39.969195 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:19:50.968458 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:19:50.968417 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:19:50.968942 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:19:50.968629 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:20:02.968141 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:20:02.968103 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:20:02.968679 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:20:02.968283 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:20:15.974692 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:20:15.974662 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:20:15.975092 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:20:15.974857 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:20:26.968930 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:20:26.968896 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:20:26.969315 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:20:26.969061 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:20:40.968592 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:20:40.968556 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:20:40.969100 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:20:40.968786 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:20:55.974285 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:20:55.974257 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:20:55.974770 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:20:55.974425 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:21:08.968566 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:08.968480 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:21:08.969042 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:21:08.968750 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:21:23.970392 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:23.970362 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:21:23.970814 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:21:23.970547 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:21:38.968379 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:38.968350 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:21:38.968799 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:21:38.968512 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:21:43.962025 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:43.961996 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:21:43.962573 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:43.962440 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:21:50.968953 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:21:50.968920 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:21:50.969470 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:21:50.969089 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:22:05.968189 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:22:05.968152 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:22:05.968808 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:22:05.968405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:22:17.968945 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:22:17.968913 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:22:17.969404 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:22:17.969079 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:22:30.968063 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:22:30.968030 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:22:30.968520 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:22:30.968200 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:22:41.969200 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:22:41.969168 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:22:41.971419 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:22:41.969409 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:22:54.968822 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:22:54.968787 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:22:54.969306 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:22:54.968993 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:23:09.969174 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:09.969135 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:23:09.969719 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:23:09.969358 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:23:14.515261 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:14.515230 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-k5t6r_3b3b4073-10f8-48fd-896d-52d7ae765f2f/manager/6.log" Jul 29 15:23:22.968989 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:22.968954 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:23:22.969447 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:23:22.969156 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:23:33.970756 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:33.970714 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:23:33.971228 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:23:33.970931 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:23:41.977212 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:41.977180 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jjwrx_e4f0425b-802f-4b3a-b2eb-a7747778dfde/global-pull-secret-syncer/0.log" Jul 29 15:23:42.105132 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:42.105101 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qvvrs_73879b34-8cbc-4439-91c4-ccef773610ba/konnectivity-agent/0.log" Jul 29 15:23:42.152632 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:42.152604 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-6.ec2.internal_a451fcd7dba34c111ce1bc770c865cd5/haproxy/0.log" Jul 29 15:23:46.267702 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.267663 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-fvc99_ac0f7491-5611-47ca-a0ba-79c581a542d6/monitoring-plugin/0.log" Jul 29 15:23:46.302574 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.302530 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nmdj_d346dc6f-17e6-4a74-b96c-d1b283d01961/node-exporter/0.log" Jul 29 15:23:46.329991 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.329965 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nmdj_d346dc6f-17e6-4a74-b96c-d1b283d01961/kube-rbac-proxy/0.log" Jul 29 15:23:46.360061 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.360035 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nmdj_d346dc6f-17e6-4a74-b96c-d1b283d01961/init-textfile/0.log" Jul 29 15:23:46.875321 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.875289 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qxsml_a9aec634-3963-443e-8bad-c2f37107a73b/prometheus-operator/0.log" Jul 29 15:23:46.903071 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:46.903044 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qxsml_a9aec634-3963-443e-8bad-c2f37107a73b/kube-rbac-proxy/0.log" Jul 29 15:23:47.113328 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.113300 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/thanos-query/0.log" Jul 29 15:23:47.144675 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.144597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/kube-rbac-proxy-web/0.log" Jul 29 15:23:47.178031 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.178008 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/kube-rbac-proxy/0.log" Jul 29 15:23:47.203670 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.203634 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/prom-label-proxy/0.log" Jul 29 15:23:47.230583 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.230555 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/kube-rbac-proxy-rules/0.log" Jul 29 15:23:47.255327 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.255279 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd56fd977-g55vv_22ce06f4-07c1-46c1-a486-8e6a301eefa8/kube-rbac-proxy-metrics/0.log" Jul 29 15:23:47.969058 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:47.969030 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:23:47.969408 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:23:47.969224 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:23:48.590537 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:48.590507 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-kdzfn_a95c2cef-ea07-4830-9f70-3514c154f70f/networking-console-plugin/0.log" Jul 29 15:23:49.521678 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.521642 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5897b98d59-sgtnn_9f38023a-48d3-4927-811c-db1caecb5c18/console/0.log" Jul 29 15:23:49.554053 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.554019 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-xz8gp_50137084-5fe9-4bf1-945b-d727d3006c81/download-server/0.log" Jul 29 15:23:49.877689 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.877607 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4"] Jul 29 15:23:49.878014 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.877969 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d66b197-e686-4287-891f-8a67d86e1671" containerName="console" Jul 29 15:23:49.878014 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.877990 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d66b197-e686-4287-891f-8a67d86e1671" containerName="console" Jul 29 15:23:49.878142 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.878064 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d66b197-e686-4287-891f-8a67d86e1671" containerName="console" Jul 29 15:23:49.880909 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.880894 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:49.883325 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.883305 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvxxh\"/\"kube-root-ca.crt\"" Jul 29 15:23:49.883442 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.883337 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvxxh\"/\"openshift-service-ca.crt\"" Jul 29 15:23:49.884316 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.884298 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bvxxh\"/\"default-dockercfg-df96c\"" Jul 29 15:23:49.891870 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.891851 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4"] Jul 29 15:23:49.903432 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.903394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-sys\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:49.903557 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.903437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-proc\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:49.903557 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.903487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-podres\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:49.903656 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.903607 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-lib-modules\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:49.903700 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:49.903663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwkb5\" (UniqueName: \"kubernetes.io/projected/8824a58c-5515-4c45-b821-a2625f94f599-kube-api-access-nwkb5\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004337 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwkb5\" (UniqueName: \"kubernetes.io/projected/8824a58c-5515-4c45-b821-a2625f94f599-kube-api-access-nwkb5\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-sys\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-proc\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-podres\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004427 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-lib-modules\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-sys\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004542 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-proc\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004875 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004562 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-lib-modules\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.004875 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.004567 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8824a58c-5515-4c45-b821-a2625f94f599-podres\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.012865 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.012840 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwkb5\" (UniqueName: \"kubernetes.io/projected/8824a58c-5515-4c45-b821-a2625f94f599-kube-api-access-nwkb5\") pod \"perf-node-gather-daemonset-8t5z4\" (UID: \"8824a58c-5515-4c45-b821-a2625f94f599\") " pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.105098 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.105056 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-nckg7_4d530559-ce2f-4095-9dc9-df0be691a22f/volume-data-source-validator/0.log" Jul 29 15:23:50.192978 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.192892 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:50.328275 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.328249 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4"] Jul 29 15:23:50.330932 ip-10-0-135-6 kubenswrapper[2583]: W0729 15:23:50.330905 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8824a58c_5515_4c45_b821_a2625f94f599.slice/crio-ea2b35954f627480d3dbe304a19f6abb1ffcbecb9b07cf403df764f2fdae348c WatchSource:0}: Error finding container ea2b35954f627480d3dbe304a19f6abb1ffcbecb9b07cf403df764f2fdae348c: Status 404 returned error can't find the container with id ea2b35954f627480d3dbe304a19f6abb1ffcbecb9b07cf403df764f2fdae348c Jul 29 15:23:50.386742 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.386693 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" event={"ID":"8824a58c-5515-4c45-b821-a2625f94f599","Type":"ContainerStarted","Data":"3653205cbf044dff9ae1dee2e15feb913029fe2eeb68b912df02d34e77f5e761"} Jul 29 15:23:50.386848 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:50.386761 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" event={"ID":"8824a58c-5515-4c45-b821-a2625f94f599","Type":"ContainerStarted","Data":"ea2b35954f627480d3dbe304a19f6abb1ffcbecb9b07cf403df764f2fdae348c"} Jul 29 15:23:51.195886 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.195856 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6jxv_754c15e6-cffe-49f2-9287-403c2f7c7bf2/dns/0.log" Jul 29 15:23:51.222062 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.222031 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6jxv_754c15e6-cffe-49f2-9287-403c2f7c7bf2/kube-rbac-proxy/0.log" Jul 29 15:23:51.249872 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.249844 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d24pq_dbda1a84-932c-4c2d-8dfb-7eee5f080dbf/dns-node-resolver/0.log" Jul 29 15:23:51.390692 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.390659 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:23:51.408085 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.408036 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" podStartSLOduration=2.408019324 podStartE2EDuration="2.408019324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:23:51.406525435 +0000 UTC m=+1327.868015929" watchObservedRunningTime="2026-07-29 15:23:51.408019324 +0000 UTC m=+1327.869509820" Jul 29 15:23:51.788846 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.788820 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bd4598459-lgjmp_1e7cb694-b81c-43ee-b71b-3c047f4803e2/registry/0.log" Jul 29 15:23:51.924781 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:51.924756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6t5n_ddd5073b-4652-4ce0-ae7f-ff0d32952135/node-ca/0.log" Jul 29 15:23:53.188652 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:53.188623 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skv29_76c5d043-eaa6-43b1-b03b-990ddcbc3e29/serve-healthcheck-canary/0.log" Jul 29 15:23:53.668937 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:53.668912 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bvlql_735f57de-b8ff-4c41-a20b-7007fe890fbb/kube-rbac-proxy/0.log" Jul 29 15:23:53.692394 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:53.692364 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bvlql_735f57de-b8ff-4c41-a20b-7007fe890fbb/exporter/0.log" Jul 29 15:23:53.717262 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:53.717234 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bvlql_735f57de-b8ff-4c41-a20b-7007fe890fbb/extractor/0.log" Jul 29 15:23:55.867826 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:55.867792 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6f77c7fb78-jcmhc_20247be9-8144-455c-a3fc-7fe273c5ef88/manager/0.log" Jul 29 15:23:55.893376 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:55.893347 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-k5t6r_3b3b4073-10f8-48fd-896d-52d7ae765f2f/manager/6.log" Jul 29 15:23:55.893532 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:55.893351 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-k5t6r_3b3b4073-10f8-48fd-896d-52d7ae765f2f/manager/6.log" Jul 29 15:23:57.404389 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:23:57.404361 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bvxxh/perf-node-gather-daemonset-8t5z4" Jul 29 15:24:00.225341 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:00.225265 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm_6a5cc648-ad7f-4049-b0e4-8d7dfd0009da/kube-storage-version-migrator-operator/1.log" Jul 29 15:24:00.226104 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:00.226087 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-jr7pm_6a5cc648-ad7f-4049-b0e4-8d7dfd0009da/kube-storage-version-migrator-operator/0.log" Jul 29 15:24:01.455976 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.455947 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/kube-multus-additional-cni-plugins/0.log" Jul 29 15:24:01.480205 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.480174 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/egress-router-binary-copy/0.log" Jul 29 15:24:01.506316 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.506294 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/cni-plugins/0.log" Jul 29 15:24:01.538077 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.538047 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/bond-cni-plugin/0.log" Jul 29 15:24:01.561514 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.561486 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/routeoverride-cni/0.log" Jul 29 15:24:01.589913 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.589846 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/whereabouts-cni-bincopy/0.log" Jul 29 15:24:01.620075 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.620050 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g4df6_86599312-b29d-4a37-a0c4-4bba97dabae3/whereabouts-cni/0.log" Jul 29 15:24:01.912500 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.912419 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zqfgt_ca630015-a15c-489c-80ee-a47d191755af/kube-multus/0.log" Jul 29 15:24:01.968707 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:01.968672 2583 scope.go:117] "RemoveContainer" containerID="3279af930be9e1a9dac18c87283d309b0f0891653caf37c6e5c35a61c2d1857c" Jul 29 15:24:01.968992 ip-10-0-135-6 kubenswrapper[2583]: E0729 15:24:01.968967 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-k5t6r_kserve(3b3b4073-10f8-48fd-896d-52d7ae765f2f)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-k5t6r" podUID="3b3b4073-10f8-48fd-896d-52d7ae765f2f" Jul 29 15:24:02.060468 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:02.060434 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ks9kp_66a880ce-7fe5-4b08-94fc-e666cbdc59dd/network-metrics-daemon/0.log" Jul 29 15:24:02.092839 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:02.092811 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ks9kp_66a880ce-7fe5-4b08-94fc-e666cbdc59dd/kube-rbac-proxy/0.log" Jul 29 15:24:03.142999 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.142963 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-controller/0.log" Jul 29 15:24:03.167681 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.167648 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/1.log" Jul 29 15:24:03.168328 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.168310 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovn-acl-logging/0.log" Jul 29 15:24:03.192484 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.192459 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/kube-rbac-proxy-node/0.log" Jul 29 15:24:03.223008 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.222982 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:24:03.253841 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.253814 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/northd/0.log" Jul 29 15:24:03.280984 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.280959 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/nbdb/0.log" Jul 29 15:24:03.311854 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.311822 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/sbdb/0.log" Jul 29 15:24:03.359895 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:03.359858 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fknlj_3548b7b6-2bde-4aff-ba4e-426360667b84/ovnkube-controller/0.log" Jul 29 15:24:04.890001 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:04.889968 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xcfdp_a34dc8b4-b605-4919-8b1d-3ff992a3fd02/network-check-target-container/0.log" Jul 29 15:24:05.806652 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:05.806585 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8k6gx_fee60bb3-da92-4fef-8f8c-157442bac820/iptables-alerter/0.log" Jul 29 15:24:06.520509 ip-10-0-135-6 kubenswrapper[2583]: I0729 15:24:06.520481 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-skv67_28acc0d0-5408-41bb-a60b-e29bf780d9c2/tuned/0.log"