Jun 08 11:51:40.337840 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 11:51:40.337854 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 11:51:40.337861 ip-10-0-140-135 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 11:51:40.338128 ip-10-0-140-135 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 11:51:49.378016 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 08 11:51:49.378029 ip-10-0-140-135 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5ced602753454020a027ed3914a0fa88 -- Jun 08 11:54:03.479672 ip-10-0-140-135 systemd[1]: Starting Kubernetes Kubelet... Jun 08 11:54:03.931050 ip-10-0-140-135 kubenswrapper[2517]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 11:54:03.931050 ip-10-0-140-135 kubenswrapper[2517]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 11:54:03.931050 ip-10-0-140-135 kubenswrapper[2517]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 11:54:03.931050 ip-10-0-140-135 kubenswrapper[2517]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 11:54:03.931050 ip-10-0-140-135 kubenswrapper[2517]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 11:54:03.931724 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.931117 2517 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 11:54:03.936693 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936677 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.936693 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936693 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936698 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936701 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936705 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936708 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936716 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936720 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936723 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936725 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936728 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936730 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936733 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936736 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936739 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936741 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936744 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936748 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936752 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936755 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.936757 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936757 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936760 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936764 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936767 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936770 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936773 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936776 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936779 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936782 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936785 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936787 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936790 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936793 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936795 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936798 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936800 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936803 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936806 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936809 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936812 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.937211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936815 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936818 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936820 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936823 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936826 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936828 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936831 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936833 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936836 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936838 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936841 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936843 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936845 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936848 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936851 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936855 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936857 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936860 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936863 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936865 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.937715 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936868 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936871 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936873 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936876 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936879 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936882 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936884 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936887 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936890 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936893 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936896 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936899 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936902 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936905 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936908 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936911 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936914 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936916 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936921 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.938206 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936924 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936927 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936930 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936933 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936936 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936940 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936944 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936948 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936950 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936953 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936956 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936959 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936962 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936964 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936967 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936969 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936972 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936974 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936977 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.938717 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.936979 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937700 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937706 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937709 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937713 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937716 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937719 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937722 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937725 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937728 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937731 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937733 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937736 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937739 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937741 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937744 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937747 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937751 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937754 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.939250 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937758 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937761 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937764 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937767 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937770 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937773 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937775 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937778 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937780 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937783 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937786 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937789 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937791 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937793 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937796 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937799 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937803 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937806 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937810 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937813 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.939753 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937816 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937819 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937822 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937825 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937828 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937830 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937833 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937836 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937839 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937841 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937844 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937846 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937849 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937853 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937856 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937859 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937862 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937864 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937867 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937870 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.940246 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937872 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937875 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937877 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937880 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937883 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937886 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937888 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937893 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937895 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937898 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937901 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937905 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937907 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937910 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937922 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937926 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937930 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937933 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937936 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.940755 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937939 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937942 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937945 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937948 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937950 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937954 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937957 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937959 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937962 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937965 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937967 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937970 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937973 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937975 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937978 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937981 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937983 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937986 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937988 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937991 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.941258 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937994 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.937996 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938369 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938373 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938383 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938386 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938389 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938392 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938395 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938398 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938401 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938404 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938407 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938410 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938413 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938415 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938418 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938421 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938424 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938427 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.941768 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938429 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938432 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938435 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938438 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938440 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938443 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938445 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938448 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938450 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938453 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938456 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938458 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938461 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938464 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938467 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938469 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938472 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938475 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938478 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938481 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.942260 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938483 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938486 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938488 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938491 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938493 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938497 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938501 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938504 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938507 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938509 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938512 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938515 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938518 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938520 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938523 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938526 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938528 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938531 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938533 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.942786 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938536 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938538 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938541 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938543 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938546 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938549 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938551 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938554 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938556 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938559 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938561 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938564 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938567 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938569 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938572 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938577 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938579 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938582 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938585 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938587 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.943274 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938590 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938593 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938595 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938598 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938601 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938603 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938606 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938611 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938614 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938618 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938621 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938624 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938627 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938631 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938634 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938637 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938640 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938642 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938645 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.943792 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938648 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938652 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.938655 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938729 2517 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938743 2517 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938749 2517 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938754 2517 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938758 2517 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938762 2517 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938766 2517 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938770 2517 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938774 2517 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938777 2517 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938781 2517 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938784 2517 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938787 2517 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938790 2517 flags.go:64] FLAG: --cgroup-root="" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938793 2517 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938796 2517 flags.go:64] FLAG: --client-ca-file="" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938799 2517 flags.go:64] FLAG: --cloud-provider="external" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938802 2517 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938807 2517 flags.go:64] FLAG: --cluster-domain="" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938810 2517 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 11:54:03.944270 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938813 2517 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938816 2517 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938819 2517 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938823 2517 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938826 2517 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938829 2517 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938832 2517 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938835 2517 flags.go:64] FLAG: --contention-profiling="false" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938838 2517 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938841 2517 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938844 2517 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938847 2517 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938851 2517 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938854 2517 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938857 2517 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938860 2517 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938864 2517 flags.go:64] FLAG: --enable-server="true" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938868 2517 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938872 2517 flags.go:64] FLAG: --event-burst="100" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938876 2517 flags.go:64] FLAG: --event-qps="50" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938881 2517 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938884 2517 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938887 2517 flags.go:64] FLAG: --eviction-hard="" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938891 2517 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 11:54:03.944876 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938894 2517 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938897 2517 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938900 2517 flags.go:64] FLAG: --eviction-soft="" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938903 2517 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938906 2517 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938909 2517 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938912 2517 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938915 2517 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938917 2517 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938920 2517 flags.go:64] FLAG: --feature-gates="" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938924 2517 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938927 2517 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938930 2517 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938933 2517 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938936 2517 flags.go:64] FLAG: --healthz-port="10248" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938939 2517 flags.go:64] FLAG: --help="false" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938942 2517 flags.go:64] FLAG: --hostname-override="ip-10-0-140-135.ec2.internal" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938945 2517 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938949 2517 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938952 2517 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938955 2517 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938959 2517 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938962 2517 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 11:54:03.945498 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938965 2517 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938968 2517 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938973 2517 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938976 2517 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938979 2517 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938983 2517 flags.go:64] FLAG: --kube-reserved="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938986 2517 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938988 2517 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938992 2517 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938995 2517 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.938997 2517 flags.go:64] FLAG: --lock-file="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939000 2517 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939003 2517 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939006 2517 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939012 2517 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939015 2517 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939017 2517 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939020 2517 flags.go:64] FLAG: --logging-format="text" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939023 2517 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939027 2517 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939030 2517 flags.go:64] FLAG: --manifest-url="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939033 2517 flags.go:64] FLAG: --manifest-url-header="" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939036 2517 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939039 2517 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939043 2517 flags.go:64] FLAG: --max-pods="110" Jun 08 11:54:03.946083 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939046 2517 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939049 2517 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939051 2517 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939054 2517 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939057 2517 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939060 2517 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939063 2517 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939069 2517 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939072 2517 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939077 2517 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939080 2517 flags.go:64] FLAG: --pod-cidr="" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939083 2517 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939088 2517 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939093 2517 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939096 2517 flags.go:64] FLAG: --pods-per-core="0" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939099 2517 flags.go:64] FLAG: --port="10250" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939102 2517 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939105 2517 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d93fb961754371ac" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939108 2517 flags.go:64] FLAG: --qos-reserved="" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939111 2517 flags.go:64] FLAG: --read-only-port="10255" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939114 2517 flags.go:64] FLAG: --register-node="true" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939117 2517 flags.go:64] FLAG: --register-with-taints="" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939123 2517 flags.go:64] FLAG: --registry-burst="10" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939126 2517 flags.go:64] FLAG: --registry-qps="5" Jun 08 11:54:03.946947 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939128 2517 flags.go:64] FLAG: --reserved-cpus="" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939131 2517 flags.go:64] FLAG: --reserved-memory="" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939135 2517 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939138 2517 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939141 2517 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939144 2517 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939147 2517 flags.go:64] FLAG: --runonce="false" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939150 2517 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939152 2517 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939155 2517 flags.go:64] FLAG: --seccomp-default="false" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939158 2517 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939161 2517 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939164 2517 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939168 2517 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939171 2517 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939173 2517 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939176 2517 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939180 2517 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939183 2517 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939187 2517 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939190 2517 flags.go:64] FLAG: --system-cgroups="" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939194 2517 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939199 2517 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939202 2517 flags.go:64] FLAG: --tls-cert-file="" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939205 2517 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 11:54:03.947705 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939209 2517 flags.go:64] FLAG: --tls-min-version="" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939212 2517 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939215 2517 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939218 2517 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939221 2517 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939223 2517 flags.go:64] FLAG: --v="2" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939227 2517 flags.go:64] FLAG: --version="false" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939231 2517 flags.go:64] FLAG: --vmodule="" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939235 2517 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.939238 2517 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939366 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939371 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939375 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939378 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939382 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939385 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939387 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939391 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939395 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939399 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939402 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.948330 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939405 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939408 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939411 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939414 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939417 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939423 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939426 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939429 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939432 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939434 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939437 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939439 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939442 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939445 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939447 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939450 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939452 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939455 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939457 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939460 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.948903 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939462 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939465 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939467 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939470 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939474 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939476 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939479 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939481 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939484 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939486 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939489 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939491 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939494 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939497 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939499 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939502 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939506 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939510 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939514 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.949520 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939517 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939520 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939523 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939525 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939528 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939531 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939533 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939536 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939539 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939541 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939544 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939546 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939549 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939551 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939554 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939557 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939559 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939562 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939564 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939567 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.950001 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939570 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939572 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939575 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939577 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939580 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939582 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939585 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939588 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939591 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939593 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939596 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939598 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939602 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939605 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939607 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939610 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939612 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939615 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939617 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939620 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.950503 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939623 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939626 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939628 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939631 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939633 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939636 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939638 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939641 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.939643 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.940281 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.948181 2517 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.948194 2517 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.949004 2517 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.949014 2517 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 11:54:03.950990 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949074 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949079 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949083 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949086 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949090 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949094 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949097 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949100 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949102 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949105 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949108 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949111 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949114 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949117 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949119 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949122 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949126 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949129 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949132 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.951351 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949135 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949137 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949140 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949142 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949146 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949150 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949153 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949156 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949159 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949162 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949165 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949168 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949171 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949173 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949177 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949181 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949184 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949187 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949190 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949193 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.951821 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949196 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949199 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949202 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949206 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949209 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949212 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949215 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949218 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949221 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949224 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949227 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949230 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949233 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949236 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949238 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949241 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949244 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949246 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949249 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949251 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.952304 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949254 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949256 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949259 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949262 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949265 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949268 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949270 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949273 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949276 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949278 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949281 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949283 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949286 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949289 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949291 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949294 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949297 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949300 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949303 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.952799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949306 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949310 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949312 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949315 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949317 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949320 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949322 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949326 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949328 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949331 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949334 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949357 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949361 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949364 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949366 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949369 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949372 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949374 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949377 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949380 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.953254 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949383 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.949388 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949505 2517 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949510 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949513 2517 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949516 2517 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949519 2517 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949523 2517 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949526 2517 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949529 2517 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949532 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949535 2517 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949538 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949541 2517 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949544 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 11:54:03.953836 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949547 2517 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949549 2517 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949552 2517 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949555 2517 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949558 2517 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949561 2517 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949564 2517 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949566 2517 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949569 2517 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949572 2517 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949574 2517 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949577 2517 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949579 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949582 2517 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949584 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949587 2517 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949589 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949592 2517 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949595 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949597 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 11:54:03.954239 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949599 2517 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949602 2517 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949605 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949608 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949610 2517 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949613 2517 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949616 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949618 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949621 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949624 2517 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949626 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949629 2517 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949632 2517 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949635 2517 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949638 2517 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949640 2517 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949643 2517 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949646 2517 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949648 2517 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949651 2517 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 11:54:03.954734 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949653 2517 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949656 2517 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949658 2517 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949661 2517 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949663 2517 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949666 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949668 2517 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949671 2517 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949673 2517 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949676 2517 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949678 2517 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949681 2517 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949683 2517 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949686 2517 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949688 2517 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949691 2517 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949693 2517 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949696 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949699 2517 feature_gate.go:328] unrecognized feature gate: Example Jun 08 11:54:03.955211 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949703 2517 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949707 2517 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949710 2517 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949713 2517 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949716 2517 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949719 2517 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949724 2517 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949727 2517 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949730 2517 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949732 2517 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949735 2517 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949738 2517 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949741 2517 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949743 2517 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949746 2517 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949748 2517 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949750 2517 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949753 2517 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949756 2517 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 11:54:03.955688 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949758 2517 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949761 2517 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949763 2517 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949766 2517 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949768 2517 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949771 2517 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949773 2517 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:03.949776 2517 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.949781 2517 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.949884 2517 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.952814 2517 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.954239 2517 server.go:1019] "Starting client certificate rotation" Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.954348 2517 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 11:54:03.956143 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.954379 2517 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 11:54:03.956928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.956914 2517 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 11:54:03.959293 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.959279 2517 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 11:54:03.979819 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.979797 2517 log.go:25] "Validated CRI v1 runtime API" Jun 08 11:54:03.982002 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.981988 2517 log.go:25] "Validated CRI v1 image API" Jun 08 11:54:03.983247 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.983231 2517 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 11:54:03.984499 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.984483 2517 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 11:54:03.989309 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.989290 2517 fs.go:135] Filesystem UUIDs: map[14d0833d-444e-42ff-944b-82849e49a479:/dev/nvme0n1p3 34314760-6129-4b7a-9996-9ef85ffb0ae7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 08 11:54:03.989392 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.989309 2517 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 11:54:03.995735 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.995621 2517 manager.go:216] Machine: {Timestamp:2026-06-08 11:54:03.994468403 +0000 UTC m=+0.379156987 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2500006 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe978fbc427a9ad7327f29ae39c4c SystemUUID:ec2fe978-fbc4-27a9-ad73-27f29ae39c4c BootID:5ced6027-5345-4020-a027-ed3914a0fa88 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:1c:b4:ef:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:1c:b4:ef:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:b7:3f:e0:84:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 11:54:03.995735 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.995726 2517 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 11:54:03.995873 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.995800 2517 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 11:54:03.997309 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.997278 2517 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 11:54:03.997454 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.997311 2517 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 11:54:03.998440 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.998430 2517 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 11:54:03.998479 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.998443 2517 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 11:54:03.998479 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.998451 2517 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 11:54:03.998999 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.998989 2517 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 11:54:03.999662 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:03.999653 2517 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 11:54:04.002176 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002164 2517 state_mem.go:36] "Initialized new in-memory state store" Jun 08 11:54:04.002284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002275 2517 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 11:54:04.002317 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002304 2517 kubelet.go:486] "Attempting to sync node with API server" Jun 08 11:54:04.002317 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002314 2517 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 11:54:04.002392 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002329 2517 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 11:54:04.002392 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002354 2517 kubelet.go:398] "Adding apiserver pod source" Jun 08 11:54:04.002392 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002368 2517 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 11:54:04.002806 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002782 2517 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 11:54:04.002843 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.002824 2517 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 11:54:04.004721 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.004694 2517 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 11:54:04.006566 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.006554 2517 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 11:54:04.006631 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.006583 2517 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 11:54:04.007109 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007098 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 11:54:04.007149 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007115 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 11:54:04.007149 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007122 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 11:54:04.007149 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007128 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 11:54:04.007149 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007136 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 11:54:04.007149 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007142 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007237 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007243 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007250 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007256 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007264 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 11:54:04.007279 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.007272 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 11:54:04.008059 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.008048 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 11:54:04.008059 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.008058 2517 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 11:54:04.011568 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.011553 2517 server.go:1268] "Started kubelet" Jun 08 11:54:04.011645 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.011619 2517 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 11:54:04.012214 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.012159 2517 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 11:54:04.012290 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.012236 2517 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 11:54:04.013237 ip-10-0-140-135 systemd[1]: Started Kubernetes Kubelet. Jun 08 11:54:04.013878 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.013497 2517 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 11:54:04.014945 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.014924 2517 server.go:310] "Adding debug handlers to kubelet server" Jun 08 11:54:04.015635 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.015614 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 11:54:04.015635 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.015623 2517 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 11:54:04.015758 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.015653 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 11:54:04.017520 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.016498 2517 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-135.ec2.internal.18b718fb02d29061 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-135.ec2.internal,UID:ip-10-0-140-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-135.ec2.internal,},FirstTimestamp:2026-06-08 11:54:04.011532385 +0000 UTC m=+0.396220968,LastTimestamp:2026-06-08 11:54:04.011532385 +0000 UTC m=+0.396220968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-135.ec2.internal,}" Jun 08 11:54:04.018473 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.018448 2517 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 11:54:04.022146 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022130 2517 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 11:54:04.022305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022147 2517 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 11:54:04.022305 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.022220 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.022972 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022879 2517 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 11:54:04.022972 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022898 2517 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 11:54:04.022972 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022881 2517 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 11:54:04.023112 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022989 2517 reconstruct.go:97] "Volume reconstruction finished" Jun 08 11:54:04.023112 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.022996 2517 reconciler.go:29] "Reconciler: start to sync state" Jun 08 11:54:04.025092 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.025073 2517 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 11:54:04.025092 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.025091 2517 factory.go:55] Registering systemd factory Jun 08 11:54:04.025212 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.025100 2517 factory.go:223] Registration of the systemd container factory successfully Jun 08 11:54:04.025594 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.025552 2517 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 11:54:04.025706 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.025685 2517 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 11:54:04.025935 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.025922 2517 factory.go:153] Registering CRI-O factory Jun 08 11:54:04.026032 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.026014 2517 factory.go:223] Registration of the crio container factory successfully Jun 08 11:54:04.026135 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.026045 2517 factory.go:103] Registering Raw factory Jun 08 11:54:04.026135 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.026057 2517 manager.go:1196] Started watching for new ooms in manager Jun 08 11:54:04.026531 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.026518 2517 manager.go:349] Starting recovery of all containers Jun 08 11:54:04.028811 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.028787 2517 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7kg75" Jun 08 11:54:04.034189 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.034163 2517 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7kg75" Jun 08 11:54:04.038473 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.038455 2517 manager.go:354] Recovery completed Jun 08 11:54:04.042496 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.042483 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.044724 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.044706 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.044804 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.044737 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.044804 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.044751 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.045190 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045175 2517 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 11:54:04.045190 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045190 2517 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 11:54:04.045294 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045194 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.045294 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045207 2517 state_mem.go:36] "Initialized new in-memory state store" Jun 08 11:54:04.045850 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045837 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.045919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045862 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.045919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.045872 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.046742 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.046680 2517 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-135.ec2.internal.18b718fb04ccffa5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-135.ec2.internal,UID:ip-10-0-140-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-135.ec2.internal,},FirstTimestamp:2026-06-08 11:54:04.044722085 +0000 UTC m=+0.429410670,LastTimestamp:2026-06-08 11:54:04.044722085 +0000 UTC m=+0.429410670,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-135.ec2.internal,}" Jun 08 11:54:04.046903 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.046889 2517 policy_none.go:49] "None policy: Start" Jun 08 11:54:04.046938 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.046908 2517 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 11:54:04.046938 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.046920 2517 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 11:54:04.048572 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.048561 2517 policy_none.go:47] "Start" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.094551 2517 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.095736 2517 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.095772 2517 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.095796 2517 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.095861 2517 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097091 2517 manager.go:337] "Starting Device Plugin manager" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.097120 2517 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097129 2517 server.go:87] "Starting device plugin registration server" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097413 2517 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097427 2517 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097589 2517 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097663 2517 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.097671 2517 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.098235 2517 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.098288 2517 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.104977 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.098334 2517 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 11:54:04.196656 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.196575 2517 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal"] Jun 08 11:54:04.196768 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.196668 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.197613 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.197596 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.197732 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.197715 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.197810 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.197768 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.197810 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.197784 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.198360 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.198325 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.198440 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.198368 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.198440 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.198380 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.198440 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.198401 2517 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.199976 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.199962 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.200096 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200081 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.200139 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200112 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.200675 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200660 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.200750 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200681 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.200750 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200692 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.200750 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200706 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.200750 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200727 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.200750 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.200737 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.203021 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.203005 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.203070 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.203034 2517 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 11:54:04.203711 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.203696 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 08 11:54:04.203774 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.203716 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 11:54:04.203774 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.203729 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 08 11:54:04.207411 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.207393 2517 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.207511 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.207424 2517 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-135.ec2.internal\": node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.224034 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.224015 2517 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-135.ec2.internal\" not found" node="ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.228353 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.228328 2517 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-135.ec2.internal\" not found" node="ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.239889 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.239868 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.324898 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.324869 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.325050 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.324903 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.325050 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.324926 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.340144 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.340120 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.425561 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425535 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.425668 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425571 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.425668 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425593 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.425668 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425640 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.425787 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425700 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.425787 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.425745 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.440636 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.440614 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.530446 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.530387 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.535441 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.535418 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:04.541095 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.541074 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.641905 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.641858 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.742368 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.742327 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.842957 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.842882 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.943502 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:04.943363 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:04.953532 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.953513 2517 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 11:54:04.953678 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:04.953661 2517 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 11:54:05.037579 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.037532 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 11:49:04 +0000 UTC" deadline="2028-02-19 17:17:39.324284792 +0000 UTC" Jun 08 11:54:05.037579 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.037574 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14909h23m34.2867152s" Jun 08 11:54:05.043721 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:05.043706 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:05.100827 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:05.100744 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2800005ebd22734ffdd825485f6a9839.slice/crio-f74f800f415ddc47bccf20ed0d520a479c9c9af31ce9da180008289ec466e3ba WatchSource:0}: Error finding container f74f800f415ddc47bccf20ed0d520a479c9c9af31ce9da180008289ec466e3ba: Status 404 returned error can't find the container with id f74f800f415ddc47bccf20ed0d520a479c9c9af31ce9da180008289ec466e3ba Jun 08 11:54:05.102029 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:05.102001 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c5d6ad4d3c1d724ac8db31730eac59.slice/crio-82a92dea6fbd37fbb5ff97a3ae9fb725d2ec7d82c3df4b42b41dcac1409f371d WatchSource:0}: Error finding container 82a92dea6fbd37fbb5ff97a3ae9fb725d2ec7d82c3df4b42b41dcac1409f371d: Status 404 returned error can't find the container with id 82a92dea6fbd37fbb5ff97a3ae9fb725d2ec7d82c3df4b42b41dcac1409f371d Jun 08 11:54:05.108430 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.108411 2517 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 11:54:05.144598 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:05.144568 2517 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 08 11:54:05.168336 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.168316 2517 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 11:54:05.183950 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.183935 2517 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 11:54:05.222974 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.222949 2517 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 08 11:54:05.236649 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.236630 2517 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 11:54:05.241720 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.241706 2517 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 08 11:54:05.257549 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.257536 2517 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 11:54:05.549772 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.549747 2517 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 11:54:05.850081 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:05.850005 2517 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 11:54:06.006287 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.006259 2517 apiserver.go:52] "Watching apiserver" Jun 08 11:54:06.014923 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.014894 2517 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 11:54:06.016354 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.016313 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-b22hk","kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lr4v6","openshift-multus/network-metrics-daemon-vhzrt","openshift-network-diagnostics/network-check-target-gbl27","openshift-network-operator/iptables-alerter-gfdhf","openshift-ovn-kubernetes/ovnkube-node-w89bg","kube-system/global-pull-secret-syncer-2z2lb","kube-system/konnectivity-agent-jl9t8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh","openshift-dns/node-resolver-64947","openshift-image-registry/node-ca-4f7r5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal","openshift-multus/multus-5mtmv"] Jun 08 11:54:06.019037 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.019012 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.021138 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.021116 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.021671 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.021494 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 11:54:06.023976 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.023956 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.023976 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.023968 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.024121 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024027 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bzrbq\"" Jun 08 11:54:06.024121 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024070 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 11:54:06.024121 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.023960 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.024121 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024030 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.024359 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024221 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 11:54:06.024359 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024232 2517 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 11:54:06.024460 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024385 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pbczq\"" Jun 08 11:54:06.024460 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024404 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 11:54:06.024745 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.024728 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.026837 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.026565 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.026837 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.026691 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:06.028979 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.027994 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.028979 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.028391 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.028979 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.028542 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dsm6k\"" Jun 08 11:54:06.028979 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.028824 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:06.028979 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.028906 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:06.030639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.030317 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.034745 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034721 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-systemd-units\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034836 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034764 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-netns\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034836 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034796 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-var-lib-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034836 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034825 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034973 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034849 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-node-log\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034973 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034878 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-lib-modules\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.034973 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034905 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-slash\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034973 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034933 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f85a973-ad42-4680-b266-5e186db06134-ovn-node-metrics-cert\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.034973 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034961 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-modprobe-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.034985 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-kubernetes\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035020 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-systemd\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035046 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-run\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035076 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-kubelet\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035102 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-bin\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035126 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w72md\" (UniqueName: \"kubernetes.io/projected/9f85a973-ad42-4680-b266-5e186db06134-kube-api-access-w72md\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035154 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-tmp\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035208 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbh2h\" (UniqueName: \"kubernetes.io/projected/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-kube-api-access-mbh2h\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035276 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-systemd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035324 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-etc-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035372 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-ovn\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035415 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-sys\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035419 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035461 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-log-socket\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035501 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-env-overrides\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035586 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g468d\" (UniqueName: \"kubernetes.io/projected/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-kube-api-access-g468d\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035624 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-host\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035681 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt745\" (UniqueName: \"kubernetes.io/projected/90272da9-3221-40e8-85d0-e35d518945c9-kube-api-access-jt745\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035728 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035772 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035806 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-netd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035829 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035834 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.035998 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035933 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 11:54:06.036479 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036014 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m292n\"" Jun 08 11:54:06.036479 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.035869 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-script-lib\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.036586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036490 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-tmp-dir\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.036586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036525 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-var-lib-kubelet\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.036586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036555 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-etc-tuned\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.036586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036582 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-config\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.036771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036606 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-hosts-file\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.036771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036713 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysconfig\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.036771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036740 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.036771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.036764 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-conf\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.037931 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.037910 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.040981 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.040962 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.042508 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.042465 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 11:54:06.042638 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.042593 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 11:54:06.042733 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.042691 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dvzjj\"" Jun 08 11:54:06.042817 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.042799 2517 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 11:54:06.043192 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043171 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.043258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043191 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.043310 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.043248 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:06.043645 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043613 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 11:54:06.043713 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043662 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 11:54:06.043904 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043886 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r4m9c\"" Jun 08 11:54:06.043990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.043972 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.045523 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.045488 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.047919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.047893 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.047919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.047895 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h582v\"" Jun 08 11:54:06.048184 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.048167 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.048485 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.048469 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.048792 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.048777 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 11:54:06.050089 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.050065 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.050723 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.050699 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-47dr2\"" Jun 08 11:54:06.050942 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.050908 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 11:54:06.052247 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.051753 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 11:54:06.053231 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.052783 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 11:54:06.053231 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.053028 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 11:54:06.053231 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.053187 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-68zkk\"" Jun 08 11:54:06.053621 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.053218 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 11:54:06.061328 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.061305 2517 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjmgv" Jun 08 11:54:06.070300 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.070275 2517 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjmgv" Jun 08 11:54:06.100699 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.100626 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" event={"ID":"2800005ebd22734ffdd825485f6a9839","Type":"ContainerStarted","Data":"f74f800f415ddc47bccf20ed0d520a479c9c9af31ce9da180008289ec466e3ba"} Jun 08 11:54:06.102245 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.102220 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerStarted","Data":"82a92dea6fbd37fbb5ff97a3ae9fb725d2ec7d82c3df4b42b41dcac1409f371d"} Jun 08 11:54:06.124895 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.124871 2517 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 11:54:06.137660 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137624 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt745\" (UniqueName: \"kubernetes.io/projected/90272da9-3221-40e8-85d0-e35d518945c9-kube-api-access-jt745\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.137790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137665 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.137790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137691 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lswz\" (UniqueName: \"kubernetes.io/projected/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-kube-api-access-6lswz\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.137790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137718 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-netd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.137790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137736 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.137790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137756 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-script-lib\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.138068 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137808 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-netd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.138068 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.137823 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.138068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.137850 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:06.138247 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.138231 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:06.63818738 +0000 UTC m=+3.022875963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:06.138317 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138039 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-tmp-dir\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.138317 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138293 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-var-lib-kubelet\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138333 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-registration-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.138445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138383 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-host-slash\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.138445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138415 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysconfig\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138440 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138438 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-var-lib-kubelet\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138498 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-conf\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138531 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-tmp-dir\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138540 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-os-release\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138603 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138625 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysconfig\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.138679 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138661 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-sysctl-conf\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138679 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-socket-dir-parent\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138718 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-iptables-alerter-script\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138759 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-script-lib\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138938 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-var-lib-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.138990 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-node-log\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139024 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-lib-modules\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139064 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139055 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-bin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139088 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139124 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-serviceca\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139159 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-slash\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139193 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-modprobe-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139220 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-systemd\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139252 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139287 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-sys-fs\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.139415 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139388 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-var-lib-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139433 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-node-log\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139525 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-lib-modules\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139564 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-agent-certs\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139594 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlgww\" (UniqueName: \"kubernetes.io/projected/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-kube-api-access-hlgww\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139623 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-kubelet\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139653 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-bin\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139684 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-tmp\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.139756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139713 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbh2h\" (UniqueName: \"kubernetes.io/projected/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-kube-api-access-mbh2h\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139818 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-netns\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139851 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139876 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-os-release\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139905 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-dbus\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139941 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-systemd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.139972 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-ovn\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140000 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-sys\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140025 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-system-cni-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140061 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.140099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140093 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-log-socket\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140124 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-env-overrides\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140154 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-system-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140275 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cni-binary-copy\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140305 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-k8s-cni-cncf-io\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140330 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db5kk\" (UniqueName: \"kubernetes.io/projected/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-kube-api-access-db5kk\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140380 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-daemon-config\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140414 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-etc-kubernetes\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140445 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140476 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-etc-tuned\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140507 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cnibin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.140552 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140535 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-hostroot\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140559 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rjrm\" (UniqueName: \"kubernetes.io/projected/7ee3fc0e-a066-471f-a460-735882cd7ae3-kube-api-access-4rjrm\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140592 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-config\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140621 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-hosts-file\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140652 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-socket-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140683 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn2v7\" (UniqueName: \"kubernetes.io/projected/7429826b-64f8-43b2-95e9-a3aae18ee122-kube-api-access-tn2v7\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140712 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-systemd-units\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140742 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-netns\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140774 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140803 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140828 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-kubelet\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140856 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-conf-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140885 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140914 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-kubelet-config\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140945 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f85a973-ad42-4680-b266-5e186db06134-ovn-node-metrics-cert\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141011 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.140978 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-kubernetes\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141244 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-run\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141274 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-systemd\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141279 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-multus-certs\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141329 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-device-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141380 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-konnectivity-ca\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141405 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-kubernetes\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141410 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141444 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141456 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-slash\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141474 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w72md\" (UniqueName: \"kubernetes.io/projected/9f85a973-ad42-4680-b266-5e186db06134-kube-api-access-w72md\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141501 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141513 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-kubelet\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.141629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141520 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-host\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141666 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-cni-bin\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141742 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-etc-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141783 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-multus\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141817 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-cnibin\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141855 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g468d\" (UniqueName: \"kubernetes.io/projected/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-kube-api-access-g468d\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141917 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-host\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141919 2517 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141933 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-sys\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141968 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-ovn\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141998 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-etc-modprobe-d\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142002 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-host\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142018 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-log-socket\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.141855 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-systemd\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142072 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-etc-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142108 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90272da9-3221-40e8-85d0-e35d518945c9-run\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.142284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142130 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142429 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-run-openvswitch\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142662 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-env-overrides\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142738 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-hosts-file\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.142990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142875 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-host-run-netns\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.142990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.142957 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f85a973-ad42-4680-b266-5e186db06134-systemd-units\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.143737 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.143481 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f85a973-ad42-4680-b266-5e186db06134-ovnkube-config\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.146458 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.146419 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-tmp\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.146653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.146594 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90272da9-3221-40e8-85d0-e35d518945c9-etc-tuned\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.146781 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.146682 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f85a973-ad42-4680-b266-5e186db06134-ovn-node-metrics-cert\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.148055 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.148032 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt745\" (UniqueName: \"kubernetes.io/projected/90272da9-3221-40e8-85d0-e35d518945c9-kube-api-access-jt745\") pod \"tuned-lr4v6\" (UID: \"90272da9-3221-40e8-85d0-e35d518945c9\") " pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.150178 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.150154 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbh2h\" (UniqueName: \"kubernetes.io/projected/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-kube-api-access-mbh2h\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.150273 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.150174 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w72md\" (UniqueName: \"kubernetes.io/projected/9f85a973-ad42-4680-b266-5e186db06134-kube-api-access-w72md\") pod \"ovnkube-node-w89bg\" (UID: \"9f85a973-ad42-4680-b266-5e186db06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.150813 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.150753 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g468d\" (UniqueName: \"kubernetes.io/projected/f6af153f-e31d-4b1f-a657-b3a503a0fc6e-kube-api-access-g468d\") pod \"node-resolver-64947\" (UID: \"f6af153f-e31d-4b1f-a657-b3a503a0fc6e\") " pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.242373 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242328 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cnibin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242384 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-hostroot\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242408 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rjrm\" (UniqueName: \"kubernetes.io/projected/7ee3fc0e-a066-471f-a460-735882cd7ae3-kube-api-access-4rjrm\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242430 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cnibin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242434 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-socket-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242487 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn2v7\" (UniqueName: \"kubernetes.io/projected/7429826b-64f8-43b2-95e9-a3aae18ee122-kube-api-access-tn2v7\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242512 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-hostroot\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242517 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242556 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242557 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242537 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-socket-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242568 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-kubelet\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242593 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-conf-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242619 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242645 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-kubelet-config\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242671 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-multus-certs\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242675 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-conf-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242702 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-device-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242736 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-konnectivity-ca\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242753 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-device-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242763 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242670 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-kubelet\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242777 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-multus-certs\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242790 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242816 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242822 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-kubelet-config\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242839 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-host\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.242996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242868 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-multus\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242892 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-cnibin\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242930 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lswz\" (UniqueName: \"kubernetes.io/projected/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-kube-api-access-6lswz\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242962 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-registration-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.242984 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-host-slash\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243008 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-os-release\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243032 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-socket-dir-parent\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243035 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-cnibin\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243056 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-iptables-alerter-script\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243073 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-host\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.242841 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243127 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-bin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.243149 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:06.743123124 +0000 UTC m=+3.127811709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243184 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-multus\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243084 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-var-lib-cni-bin\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243223 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243226 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.243858 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243248 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-serviceca\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243276 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243291 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-cni-binary-copy\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243299 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-konnectivity-ca\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243305 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-os-release\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243299 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-sys-fs\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243360 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-sys-fs\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243385 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-socket-dir-parent\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243388 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-agent-certs\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243408 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-registration-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243423 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlgww\" (UniqueName: \"kubernetes.io/projected/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-kube-api-access-hlgww\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243453 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-netns\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243476 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243479 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243492 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243500 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-os-release\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243525 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-dbus\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.244653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243529 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-netns\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243552 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-system-cni-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243578 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243585 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-host-slash\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243619 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-system-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243644 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cni-binary-copy\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243670 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-k8s-cni-cncf-io\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243714 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-host-run-k8s-cni-cncf-io\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243723 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-system-cni-dir\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243722 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-system-cni-dir\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243770 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7429826b-64f8-43b2-95e9-a3aae18ee122-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243834 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ee3fc0e-a066-471f-a460-735882cd7ae3-os-release\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243883 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04bbd309-255e-4afe-8ab8-2d519b3d27df-dbus\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243916 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-serviceca\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243919 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db5kk\" (UniqueName: \"kubernetes.io/projected/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-kube-api-access-db5kk\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243959 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-daemon-config\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.243983 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-etc-kubernetes\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245258 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.244065 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-etc-kubernetes\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245867 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.244073 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-iptables-alerter-script\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.245867 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.244286 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-cni-binary-copy\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245867 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.244471 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-multus-daemon-config\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.245867 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.244526 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ee3fc0e-a066-471f-a460-735882cd7ae3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.246108 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.246088 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54849acf-4f0e-4e5f-8dff-eb02a108e9b8-agent-certs\") pod \"konnectivity-agent-jl9t8\" (UID: \"54849acf-4f0e-4e5f-8dff-eb02a108e9b8\") " pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.253295 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.253272 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:06.253295 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.253297 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:06.253473 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.253312 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:06.253473 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.253380 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:06.753365675 +0000 UTC m=+3.138054245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:06.255751 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.255728 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn2v7\" (UniqueName: \"kubernetes.io/projected/7429826b-64f8-43b2-95e9-a3aae18ee122-kube-api-access-tn2v7\") pod \"aws-ebs-csi-driver-node-mxqgh\" (UID: \"7429826b-64f8-43b2-95e9-a3aae18ee122\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.256658 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.256632 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rjrm\" (UniqueName: \"kubernetes.io/projected/7ee3fc0e-a066-471f-a460-735882cd7ae3-kube-api-access-4rjrm\") pod \"multus-additional-cni-plugins-b22hk\" (UID: \"7ee3fc0e-a066-471f-a460-735882cd7ae3\") " pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.257153 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.257127 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lswz\" (UniqueName: \"kubernetes.io/projected/4339b76c-e12e-4cdc-8dac-bd49d618f7a8-kube-api-access-6lswz\") pod \"node-ca-4f7r5\" (UID: \"4339b76c-e12e-4cdc-8dac-bd49d618f7a8\") " pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.257719 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.257693 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db5kk\" (UniqueName: \"kubernetes.io/projected/bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37-kube-api-access-db5kk\") pod \"multus-5mtmv\" (UID: \"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37\") " pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.258042 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.258022 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlgww\" (UniqueName: \"kubernetes.io/projected/16a9f6c7-d1e0-4ce8-9e02-2151146ee47a-kube-api-access-hlgww\") pod \"iptables-alerter-gfdhf\" (UID: \"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a\") " pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.334510 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.334479 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:06.345627 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.345602 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-64947" Jun 08 11:54:06.358253 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.358207 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" Jun 08 11:54:06.365265 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.365248 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gfdhf" Jun 08 11:54:06.372635 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.372617 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:06.380078 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.380062 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5mtmv" Jun 08 11:54:06.387689 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.387666 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" Jun 08 11:54:06.395255 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.395235 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b22hk" Jun 08 11:54:06.401861 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.401844 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f7r5" Jun 08 11:54:06.647045 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.647013 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:06.647192 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.647157 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:06.647259 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.647230 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:07.647213489 +0000 UTC m=+4.031902058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:06.747817 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.747783 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:06.748002 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.747939 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:06.748050 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.748007 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:07.747992465 +0000 UTC m=+4.132681033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:06.848730 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:06.848693 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:06.848898 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.848857 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:06.848898 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.848880 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:06.848898 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.848893 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:06.849030 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:06.848964 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:07.848943589 +0000 UTC m=+4.233632169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:07.051652 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.051621 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54849acf_4f0e_4e5f_8dff_eb02a108e9b8.slice/crio-06b0a52cadf7113343be8e963bdb4a9c7a2249962184d885e497113aa14c3960 WatchSource:0}: Error finding container 06b0a52cadf7113343be8e963bdb4a9c7a2249962184d885e497113aa14c3960: Status 404 returned error can't find the container with id 06b0a52cadf7113343be8e963bdb4a9c7a2249962184d885e497113aa14c3960 Jun 08 11:54:07.054255 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.054230 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9b9729_7b16_41b2_85e2_d2bf4a6f7c37.slice/crio-aa21dfb7e01d684f638cb83954bc8964b1bc01f95f3870ed9caf2632422d1a38 WatchSource:0}: Error finding container aa21dfb7e01d684f638cb83954bc8964b1bc01f95f3870ed9caf2632422d1a38: Status 404 returned error can't find the container with id aa21dfb7e01d684f638cb83954bc8964b1bc01f95f3870ed9caf2632422d1a38 Jun 08 11:54:07.056101 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.056080 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee3fc0e_a066_471f_a460_735882cd7ae3.slice/crio-12ef3e153efcd689901b9c7d3b4f395231f5deaba4ce242bba65f547fd7f67f3 WatchSource:0}: Error finding container 12ef3e153efcd689901b9c7d3b4f395231f5deaba4ce242bba65f547fd7f67f3: Status 404 returned error can't find the container with id 12ef3e153efcd689901b9c7d3b4f395231f5deaba4ce242bba65f547fd7f67f3 Jun 08 11:54:07.056854 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.056833 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6af153f_e31d_4b1f_a657_b3a503a0fc6e.slice/crio-6b76db0164b336bd403bc2e4deb43e6b76d331adf14f0b9607184d3484d6e56d WatchSource:0}: Error finding container 6b76db0164b336bd403bc2e4deb43e6b76d331adf14f0b9607184d3484d6e56d: Status 404 returned error can't find the container with id 6b76db0164b336bd403bc2e4deb43e6b76d331adf14f0b9607184d3484d6e56d Jun 08 11:54:07.057850 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.057717 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90272da9_3221_40e8_85d0_e35d518945c9.slice/crio-a80b66a49744b1a1e5c9973e19d7dfc0a76277f07a246ea41b4b28b06b435e6d WatchSource:0}: Error finding container a80b66a49744b1a1e5c9973e19d7dfc0a76277f07a246ea41b4b28b06b435e6d: Status 404 returned error can't find the container with id a80b66a49744b1a1e5c9973e19d7dfc0a76277f07a246ea41b4b28b06b435e6d Jun 08 11:54:07.058586 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.058567 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4339b76c_e12e_4cdc_8dac_bd49d618f7a8.slice/crio-e704040899ad2a636adcd78405d4533d0402c8c5f5cd13dc11832a50b857988d WatchSource:0}: Error finding container e704040899ad2a636adcd78405d4533d0402c8c5f5cd13dc11832a50b857988d: Status 404 returned error can't find the container with id e704040899ad2a636adcd78405d4533d0402c8c5f5cd13dc11832a50b857988d Jun 08 11:54:07.059510 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.059394 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f85a973_ad42_4680_b266_5e186db06134.slice/crio-9b3dbd570a52cd2fb4b12ec34b1f6a7d29f36a00ff48166dab92a239b7d4a30d WatchSource:0}: Error finding container 9b3dbd570a52cd2fb4b12ec34b1f6a7d29f36a00ff48166dab92a239b7d4a30d: Status 404 returned error can't find the container with id 9b3dbd570a52cd2fb4b12ec34b1f6a7d29f36a00ff48166dab92a239b7d4a30d Jun 08 11:54:07.060851 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.060735 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a9f6c7_d1e0_4ce8_9e02_2151146ee47a.slice/crio-0a4642c400d6f1dc5cb02d97fe34fd5973343f8560857935ad0800fdad8da7d4 WatchSource:0}: Error finding container 0a4642c400d6f1dc5cb02d97fe34fd5973343f8560857935ad0800fdad8da7d4: Status 404 returned error can't find the container with id 0a4642c400d6f1dc5cb02d97fe34fd5973343f8560857935ad0800fdad8da7d4 Jun 08 11:54:07.062107 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:07.062080 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7429826b_64f8_43b2_95e9_a3aae18ee122.slice/crio-bd3539fa64dac592987875fcb58d63bb5baab73000c5b6e6d9431d778425bea6 WatchSource:0}: Error finding container bd3539fa64dac592987875fcb58d63bb5baab73000c5b6e6d9431d778425bea6: Status 404 returned error can't find the container with id bd3539fa64dac592987875fcb58d63bb5baab73000c5b6e6d9431d778425bea6 Jun 08 11:54:07.073740 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.073702 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:49:06 +0000 UTC" deadline="2028-02-23 19:27:21.926820184 +0000 UTC" Jun 08 11:54:07.073815 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.073740 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15007h33m14.853083362s" Jun 08 11:54:07.105204 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.105177 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" event={"ID":"7429826b-64f8-43b2-95e9-a3aae18ee122","Type":"ContainerStarted","Data":"bd3539fa64dac592987875fcb58d63bb5baab73000c5b6e6d9431d778425bea6"} Jun 08 11:54:07.106234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.106198 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gfdhf" event={"ID":"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a","Type":"ContainerStarted","Data":"0a4642c400d6f1dc5cb02d97fe34fd5973343f8560857935ad0800fdad8da7d4"} Jun 08 11:54:07.107246 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.107227 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"9b3dbd570a52cd2fb4b12ec34b1f6a7d29f36a00ff48166dab92a239b7d4a30d"} Jun 08 11:54:07.108201 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.108185 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f7r5" event={"ID":"4339b76c-e12e-4cdc-8dac-bd49d618f7a8","Type":"ContainerStarted","Data":"e704040899ad2a636adcd78405d4533d0402c8c5f5cd13dc11832a50b857988d"} Jun 08 11:54:07.109247 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.109221 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5mtmv" event={"ID":"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37","Type":"ContainerStarted","Data":"aa21dfb7e01d684f638cb83954bc8964b1bc01f95f3870ed9caf2632422d1a38"} Jun 08 11:54:07.111124 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.111103 2517 generic.go:356] "Generic (PLEG): container finished" podID="27c5d6ad4d3c1d724ac8db31730eac59" containerID="7b4e6066e9baf8e614b7c120e239aa09e5f590913a063e0bd4a207262fce1c1c" exitCode=0 Jun 08 11:54:07.111197 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.111166 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerDied","Data":"7b4e6066e9baf8e614b7c120e239aa09e5f590913a063e0bd4a207262fce1c1c"} Jun 08 11:54:07.112224 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.112204 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" event={"ID":"90272da9-3221-40e8-85d0-e35d518945c9","Type":"ContainerStarted","Data":"a80b66a49744b1a1e5c9973e19d7dfc0a76277f07a246ea41b4b28b06b435e6d"} Jun 08 11:54:07.113029 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.113010 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-64947" event={"ID":"f6af153f-e31d-4b1f-a657-b3a503a0fc6e","Type":"ContainerStarted","Data":"6b76db0164b336bd403bc2e4deb43e6b76d331adf14f0b9607184d3484d6e56d"} Jun 08 11:54:07.114070 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.114042 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerStarted","Data":"12ef3e153efcd689901b9c7d3b4f395231f5deaba4ce242bba65f547fd7f67f3"} Jun 08 11:54:07.114964 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.114948 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jl9t8" event={"ID":"54849acf-4f0e-4e5f-8dff-eb02a108e9b8","Type":"ContainerStarted","Data":"06b0a52cadf7113343be8e963bdb4a9c7a2249962184d885e497113aa14c3960"} Jun 08 11:54:07.654694 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.654474 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:07.654879 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.654848 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:07.654941 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.654912 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:09.654892459 +0000 UTC m=+6.039581032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:07.755374 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.755199 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:07.755374 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.755373 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:07.755610 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.755434 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:09.755415408 +0000 UTC m=+6.140103981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:07.856613 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:07.856575 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:07.856793 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.856750 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:07.856793 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.856767 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:07.856793 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.856780 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:07.856958 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:07.856838 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:09.856819331 +0000 UTC m=+6.241507914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:08.074775 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.074660 2517 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:49:06 +0000 UTC" deadline="2028-02-25 11:44:20.576277904 +0000 UTC" Jun 08 11:54:08.074775 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.074700 2517 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15047h50m12.501582869s" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.107769 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:08.107896 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.108283 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:08.108406 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.108465 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:08.108568 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:08.108532 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:08.144726 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.144073 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" event={"ID":"2800005ebd22734ffdd825485f6a9839","Type":"ContainerStarted","Data":"f16e54a9a6872fb639a6fc6c20e6f6822c4874dd0a224f2eefaebca06ad48d4a"} Jun 08 11:54:08.149663 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.149636 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerStarted","Data":"3637706ae61ca0d3a9379f42e9929abdc677e859c78ffcda156bcdae1624f065"} Jun 08 11:54:08.177086 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:08.177010 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" podStartSLOduration=3.176992925 podStartE2EDuration="3.176992925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:08.161540091 +0000 UTC m=+4.546228685" watchObservedRunningTime="2026-06-08 11:54:08.176992925 +0000 UTC m=+4.561681517" Jun 08 11:54:09.674984 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:09.674949 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:09.675511 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.675127 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:09.675511 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.675199 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:13.675176913 +0000 UTC m=+10.059865486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:09.776127 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:09.776084 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:09.776318 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.776273 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:09.776472 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.776350 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:13.776320059 +0000 UTC m=+10.161008631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:09.877468 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:09.877428 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:09.877679 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.877629 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:09.877679 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.877656 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:09.877679 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.877670 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:09.877913 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:09.877736 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:13.87771593 +0000 UTC m=+10.262404522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:10.100517 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:10.100445 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:10.100701 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:10.100563 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:10.101195 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:10.100924 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:10.101195 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:10.101015 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:10.101195 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:10.101070 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:10.101195 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:10.101147 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:12.099887 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:12.099828 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:12.100375 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:12.099943 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:12.100375 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:12.099834 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:12.100375 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:12.100302 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:12.100542 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:12.100411 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:12.100542 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:12.100501 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:13.709135 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:13.709096 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:13.709611 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.709233 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:13.709611 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.709289 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:21.709270209 +0000 UTC m=+18.093958779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:13.810131 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:13.810005 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:13.810292 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.810173 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:13.810292 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.810246 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:21.810227053 +0000 UTC m=+18.194915633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:13.911296 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:13.911268 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:13.911490 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.911439 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:13.911490 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.911459 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:13.911490 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.911471 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:13.911652 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:13.911525 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:21.91150807 +0000 UTC m=+18.296196642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:14.097823 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:14.097563 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:14.097823 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:14.097653 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:14.097823 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:14.097692 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:14.097823 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:14.097815 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:14.098157 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:14.097848 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:14.098157 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:14.097926 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:16.096413 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:16.096283 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:16.096413 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:16.096310 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:16.096999 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:16.096427 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:16.096999 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:16.096501 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:16.096999 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:16.096605 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:16.096999 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:16.096669 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:18.096866 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:18.096806 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:18.096866 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:18.096854 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:18.097401 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:18.096926 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:18.097401 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:18.096958 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:18.097401 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:18.097018 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:18.097401 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:18.097135 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:20.096020 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:20.095987 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:20.096020 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:20.096018 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:20.096558 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:20.096123 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:20.096558 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:20.096213 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:20.096558 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:20.096284 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:20.096558 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:20.096375 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:21.769217 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:21.769180 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:21.769794 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.769287 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:21.769794 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.769359 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:37.7693265 +0000 UTC m=+34.154015068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:21.869700 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:21.869666 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:21.869905 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.869808 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:21.869905 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.869879 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:54:37.869864335 +0000 UTC m=+34.254552906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:21.970241 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:21.970209 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:21.970458 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.970425 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:21.970458 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.970446 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:21.970458 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.970456 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:21.970568 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:21.970506 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:54:37.970491929 +0000 UTC m=+34.355180499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:22.096517 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:22.096434 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:22.096517 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:22.096479 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:22.096744 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:22.096434 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:22.096744 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:22.096590 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:22.096744 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:22.096718 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:22.096869 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:22.096801 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:24.097951 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:24.097903 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:24.098567 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:24.097992 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:24.098567 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:24.098036 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:24.098567 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:24.098040 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:24.098567 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:24.098122 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:24.098567 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:24.098194 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:26.096302 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.096063 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:26.096948 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.096068 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:26.096948 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.096101 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:26.096948 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:26.096455 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:26.096948 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:26.096533 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:26.096948 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:26.096624 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:26.191614 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.191592 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:54:26.191975 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.191943 2517 generic.go:356] "Generic (PLEG): container finished" podID="9f85a973-ad42-4680-b266-5e186db06134" containerID="5e4ca17430d1277895010104fb2c63889ba53ee2e09ed61b94ddde92ec5cf85e" exitCode=1 Jun 08 11:54:26.192082 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.192005 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"292967e00cb9f9b69d39d5dc4afb8ad6d27e7882e2de675a951460b4d4efb55b"} Jun 08 11:54:26.192141 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.192078 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerDied","Data":"5e4ca17430d1277895010104fb2c63889ba53ee2e09ed61b94ddde92ec5cf85e"} Jun 08 11:54:26.192141 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.192136 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"a2c5ec08ea382b76c18ab1e1495e7efcc3ce60076884fa000c7143e0963a8f50"} Jun 08 11:54:26.193650 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.193628 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f7r5" event={"ID":"4339b76c-e12e-4cdc-8dac-bd49d618f7a8","Type":"ContainerStarted","Data":"81e0f1b561bc50c217c28ca4c9c9a52b714656c3c71d8689813105db0eebef58"} Jun 08 11:54:26.195073 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.195041 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5mtmv" event={"ID":"bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37","Type":"ContainerStarted","Data":"b67471d15cbf7c56f1a8a0e050b2af5e8923632fcbe7e466b0a214e096d9f3b6"} Jun 08 11:54:26.196470 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.196444 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" event={"ID":"90272da9-3221-40e8-85d0-e35d518945c9","Type":"ContainerStarted","Data":"0cd01d3595c97cccf66c6d804e44e15537ac51015f232771a4e22d8181478c44"} Jun 08 11:54:26.197847 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.197816 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-64947" event={"ID":"f6af153f-e31d-4b1f-a657-b3a503a0fc6e","Type":"ContainerStarted","Data":"3c883920798bba4e5c226a2db897d002260ef3e65d55cb46eb760a6ba3154f79"} Jun 08 11:54:26.199293 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.199266 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="5a4fc96fbdf693a6f3898ac082884fb10f4842b2774c46e4a0ca7283c0934393" exitCode=0 Jun 08 11:54:26.199397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.199334 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"5a4fc96fbdf693a6f3898ac082884fb10f4842b2774c46e4a0ca7283c0934393"} Jun 08 11:54:26.200906 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.200885 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jl9t8" event={"ID":"54849acf-4f0e-4e5f-8dff-eb02a108e9b8","Type":"ContainerStarted","Data":"a306fe04380433d2130b5b5f8cfa57d88570bc0532b4579a2f7eae4f2b6a1296"} Jun 08 11:54:26.202375 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.202335 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" event={"ID":"7429826b-64f8-43b2-95e9-a3aae18ee122","Type":"ContainerStarted","Data":"ded74da64dec150b9461322bbc0851e7b901735fbc016bf855d200658db7dd40"} Jun 08 11:54:26.214111 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.214071 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4f7r5" podStartSLOduration=3.5785523230000003 podStartE2EDuration="22.214058302s" totalImagesPullingTime="18.635505979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:26.213485822 +0000 UTC m=+22.598174414" watchObservedRunningTime="2026-06-08 11:54:26.214058302 +0000 UTC m=+22.598746892" Jun 08 11:54:26.214190 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.214139 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" podStartSLOduration=21.214134532 podStartE2EDuration="21.214134532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:08.177762401 +0000 UTC m=+4.562450992" watchObservedRunningTime="2026-06-08 11:54:26.214134532 +0000 UTC m=+22.598823123" Jun 08 11:54:26.255571 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.255525 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-64947" podStartSLOduration=3.619581141 podStartE2EDuration="22.255511234s" totalImagesPullingTime="18.635930093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:26.255184683 +0000 UTC m=+22.639873275" watchObservedRunningTime="2026-06-08 11:54:26.255511234 +0000 UTC m=+22.640199825" Jun 08 11:54:26.273144 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.273098 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lr4v6" podStartSLOduration=3.635998102 podStartE2EDuration="22.27308934s" totalImagesPullingTime="18.637091238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:26.272542978 +0000 UTC m=+22.657231568" watchObservedRunningTime="2026-06-08 11:54:26.27308934 +0000 UTC m=+22.657777930" Jun 08 11:54:26.288031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.287995 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jl9t8" podStartSLOduration=8.379733601 podStartE2EDuration="22.287981729s" totalImagesPullingTime="13.908248128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:26.287714455 +0000 UTC m=+22.672403065" watchObservedRunningTime="2026-06-08 11:54:26.287981729 +0000 UTC m=+22.672670319" Jun 08 11:54:26.313380 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:26.313324 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5mtmv" podStartSLOduration=3.6526132000000002 podStartE2EDuration="22.313309283s" totalImagesPullingTime="18.660696083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:26.312960196 +0000 UTC m=+22.697648788" watchObservedRunningTime="2026-06-08 11:54:26.313309283 +0000 UTC m=+22.697997873" Jun 08 11:54:27.206500 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.206470 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gfdhf" event={"ID":"16a9f6c7-d1e0-4ce8-9e02-2151146ee47a","Type":"ContainerStarted","Data":"c7010b09704f215712e96570a3d1ed37df6cc41fa868b512a2d28f9e47d3c46b"} Jun 08 11:54:27.209808 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.209789 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:54:27.210263 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.210240 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"704f701e39b420c4aff54a6171213243d088524e422057c52ee6991da974b29a"} Jun 08 11:54:27.210363 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.210314 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"5afdf925d6eed49f1fba05e243f76c3c60dc9ee4a49c209507d5b3e36c7be77c"} Jun 08 11:54:27.210403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.210382 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"8f7714baa8b297ce268ddef905f89564024ec5562ad0964fe2249ec0f17ae843"} Jun 08 11:54:27.220950 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.220911 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gfdhf" podStartSLOduration=4.589092361 podStartE2EDuration="23.220898061s" totalImagesPullingTime="18.6318057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:27.220453803 +0000 UTC m=+23.605142404" watchObservedRunningTime="2026-06-08 11:54:27.220898061 +0000 UTC m=+23.605586652" Jun 08 11:54:27.253539 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.253514 2517 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 11:54:27.411889 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.411863 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:27.412644 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.412615 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:27.518715 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.518687 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:27.519183 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:27.519162 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jl9t8" Jun 08 11:54:28.096488 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.096454 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:28.096662 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.096500 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:28.096662 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.096464 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:28.096662 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:28.096586 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:28.096818 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:28.096686 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:28.096818 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:28.096767 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:28.112154 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.112025 2517 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T11:54:27.253535351Z","UUID":"0583f464-9711-4994-8059-52c07b2bd312","Handler":null,"Name":"","Endpoint":""} Jun 08 11:54:28.113697 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.113673 2517 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 11:54:28.113830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.113728 2517 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 11:54:28.214315 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:28.214285 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" event={"ID":"7429826b-64f8-43b2-95e9-a3aae18ee122","Type":"ContainerStarted","Data":"c2a1b2b435b8d69f4edfed2c2a0320637d6151b39720b3bdbbe502efea11a84b"} Jun 08 11:54:29.219097 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:29.219052 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" event={"ID":"7429826b-64f8-43b2-95e9-a3aae18ee122","Type":"ContainerStarted","Data":"16b5c24097ddf8d7aab3312f9d9da057eac2ed907332de8cfe8deba7ab6961e7"} Jun 08 11:54:29.222310 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:29.222282 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:54:29.222690 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:29.222646 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"1c11042e8ebb024ef0cdc0200314d5aa9bd2d3b78ab66d8f7e00e9a50ab10a91"} Jun 08 11:54:29.237910 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:29.237859 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxqgh" podStartSLOduration=4.313311284 podStartE2EDuration="25.237832689s" totalImagesPullingTime="20.924521405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:29.237188248 +0000 UTC m=+25.621876839" watchObservedRunningTime="2026-06-08 11:54:29.237832689 +0000 UTC m=+25.622521294" Jun 08 11:54:30.096847 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:30.096810 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:30.097007 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:30.096824 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:30.097007 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:30.096956 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:30.097007 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:30.096950 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:30.097174 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:30.097089 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:30.097234 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:30.097169 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:31.228701 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.228625 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="0d9850dfecde17b46d1da66390d0827e0ec6e131d8caef8869b933ee1bb46351" exitCode=0 Jun 08 11:54:31.229240 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.228723 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"0d9850dfecde17b46d1da66390d0827e0ec6e131d8caef8869b933ee1bb46351"} Jun 08 11:54:31.232200 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232180 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:54:31.232549 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232528 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"10e24ad0f6d6cf5bd99f65f48ce22eaa564c76d9c9ebf69d1931479b35867a97"} Jun 08 11:54:31.232814 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232786 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:31.232910 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232858 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:31.232910 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232906 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:31.232996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.232970 2517 scope.go:117] "RemoveContainer" containerID="5e4ca17430d1277895010104fb2c63889ba53ee2e09ed61b94ddde92ec5cf85e" Jun 08 11:54:31.248427 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.248408 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:31.248669 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:31.248650 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:54:32.096767 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.096729 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:32.096938 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.096729 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:32.096938 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:32.096866 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:32.097041 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:32.096953 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:32.097041 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.096729 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:32.097145 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:32.097041 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:32.238148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.238122 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:54:32.238543 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.238469 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" event={"ID":"9f85a973-ad42-4680-b266-5e186db06134","Type":"ContainerStarted","Data":"37a6af848367d2abf61145ca545fb48f77a984d39ef9176ea7820b1877d94606"} Jun 08 11:54:32.268524 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:32.268475 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" podStartSLOduration=9.578325718 podStartE2EDuration="28.2684588s" totalImagesPullingTime="18.690133082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:32.267954556 +0000 UTC m=+28.652643183" watchObservedRunningTime="2026-06-08 11:54:32.2684588 +0000 UTC m=+28.653147392" Jun 08 11:54:33.112681 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.112517 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vhzrt"] Jun 08 11:54:33.112842 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.112787 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:33.112888 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:33.112872 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:33.116032 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.116004 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbl27"] Jun 08 11:54:33.116161 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.116121 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:33.116221 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:33.116202 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:33.116714 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.116690 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2z2lb"] Jun 08 11:54:33.116822 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.116808 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:33.116921 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:33.116901 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:33.242844 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.242809 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="4ef655e4a3dccbcca88927a3e6b4d8ba0b39ee2f12b5a66662cd6e686984be6a" exitCode=0 Jun 08 11:54:33.243309 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:33.242901 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"4ef655e4a3dccbcca88927a3e6b4d8ba0b39ee2f12b5a66662cd6e686984be6a"} Jun 08 11:54:35.097382 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:35.097305 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:35.098562 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:35.097571 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:35.098562 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:35.097666 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:35.098562 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:35.097645 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:35.098562 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:35.097913 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:35.098562 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:35.098131 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:35.248966 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:35.248893 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="07acf97bea3556e644494c7c693e10bb8aa83f3d83e3d6c0cc31085991ef6cbc" exitCode=0 Jun 08 11:54:35.248966 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:35.248933 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"07acf97bea3556e644494c7c693e10bb8aa83f3d83e3d6c0cc31085991ef6cbc"} Jun 08 11:54:37.096357 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.096316 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:37.096780 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.096318 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:37.096780 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.096453 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbl27" podUID="aa485ad7-1705-4f82-8086-cae0fc0e1bea" Jun 08 11:54:37.096780 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.096317 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:37.096780 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.096518 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2z2lb" podUID="04bbd309-255e-4afe-8ab8-2d519b3d27df" Jun 08 11:54:37.096780 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.096609 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:54:37.791223 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.791179 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:37.791422 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.791322 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:37.791422 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.791412 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:55:09.791395478 +0000 UTC m=+66.176084052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 11:54:37.892160 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.891961 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:37.892330 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.892102 2517 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:37.892330 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.892231 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret podName:04bbd309-255e-4afe-8ab8-2d519b3d27df nodeName:}" failed. No retries permitted until 2026-06-08 11:55:09.892212275 +0000 UTC m=+66.276900843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret") pod "global-pull-secret-syncer-2z2lb" (UID: "04bbd309-255e-4afe-8ab8-2d519b3d27df") : object "kube-system"/"original-pull-secret" not registered Jun 08 11:54:37.992627 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:37.992598 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:37.992817 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.992778 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 11:54:37.992817 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.992800 2517 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 11:54:37.992817 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.992812 2517 projected.go:196] Error preparing data for projected volume kube-api-access-q88hk for pod openshift-network-diagnostics/network-check-target-gbl27: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:37.992965 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:37.992876 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk podName:aa485ad7-1705-4f82-8086-cae0fc0e1bea nodeName:}" failed. No retries permitted until 2026-06-08 11:55:09.992855261 +0000 UTC m=+66.377543846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q88hk" (UniqueName: "kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk") pod "network-check-target-gbl27" (UID: "aa485ad7-1705-4f82-8086-cae0fc0e1bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 11:54:38.973563 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:38.973531 2517 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeReady" Jun 08 11:54:38.973988 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:38.973718 2517 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 11:54:39.007633 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.007602 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:54:39.035610 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.035579 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nlwsj"] Jun 08 11:54:39.035771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.035718 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.039137 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.038853 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjndr\"" Jun 08 11:54:39.039137 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.038994 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 11:54:39.039137 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.039087 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 11:54:39.039530 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.039309 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 11:54:39.045826 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.045804 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 11:54:39.048632 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.048608 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:54:39.048761 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.048650 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqmh"] Jun 08 11:54:39.048761 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.048724 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.051286 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.051266 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 11:54:39.051411 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.051300 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g2rfw\"" Jun 08 11:54:39.051411 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.051377 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 11:54:39.070305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.070284 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqmh"] Jun 08 11:54:39.070443 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.070311 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlwsj"] Jun 08 11:54:39.070443 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.070422 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.073019 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.072995 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 11:54:39.073132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.072995 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9h8gl\"" Jun 08 11:54:39.073132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.073062 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 11:54:39.073132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.073026 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 11:54:39.097019 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.096998 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:54:39.097119 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.097090 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:54:39.097290 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.097270 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099643 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099686 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7wfvl\"" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099720 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099736 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099772 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xk9wx\"" Jun 08 11:54:39.099830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.099720 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 11:54:39.199151 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199115 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.199314 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199168 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9mc\" (UniqueName: \"kubernetes.io/projected/3f7028b9-c116-490f-b863-8b6f3adb8d82-kube-api-access-8n9mc\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.199314 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199196 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f21d298-2c6b-405e-bae4-30796db38eec-cert\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.199314 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199284 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f7028b9-c116-490f-b863-8b6f3adb8d82-tmp-dir\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199322 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199369 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7028b9-c116-490f-b863-8b6f3adb8d82-config-volume\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199391 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb989\" (UniqueName: \"kubernetes.io/projected/6f21d298-2c6b-405e-bae4-30796db38eec-kube-api-access-sb989\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199409 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199437 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199463 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57h8t\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199732 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199537 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199732 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199587 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199732 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199649 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.199732 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.199676 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300404 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300314 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9mc\" (UniqueName: \"kubernetes.io/projected/3f7028b9-c116-490f-b863-8b6f3adb8d82-kube-api-access-8n9mc\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.300404 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300359 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f21d298-2c6b-405e-bae4-30796db38eec-cert\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.300593 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300510 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f7028b9-c116-490f-b863-8b6f3adb8d82-tmp-dir\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.300593 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300545 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300593 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300564 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7028b9-c116-490f-b863-8b6f3adb8d82-config-volume\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.300593 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300582 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb989\" (UniqueName: \"kubernetes.io/projected/6f21d298-2c6b-405e-bae4-30796db38eec-kube-api-access-sb989\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.300770 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300605 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300770 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300633 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300770 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300658 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57h8t\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300770 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300714 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.300770 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300737 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300801 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300810 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f7028b9-c116-490f-b863-8b6f3adb8d82-tmp-dir\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300828 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.300865 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.300999 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:39.301031 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.301021 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:39.301293 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.301086 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:39.801062672 +0000 UTC m=+36.185751255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:54:39.301293 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.301165 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7028b9-c116-490f-b863-8b6f3adb8d82-config-volume\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.301293 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.301272 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.301471 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.301386 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:39.301471 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.301456 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:39.801434908 +0000 UTC m=+36.186123489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:39.301576 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.301549 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.302407 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.302385 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.304547 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.304529 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.304647 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.304582 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.304647 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.304633 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f21d298-2c6b-405e-bae4-30796db38eec-cert\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.308971 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.308937 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9mc\" (UniqueName: \"kubernetes.io/projected/3f7028b9-c116-490f-b863-8b6f3adb8d82-kube-api-access-8n9mc\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.309242 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.309221 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.309771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.309729 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb989\" (UniqueName: \"kubernetes.io/projected/6f21d298-2c6b-405e-bae4-30796db38eec-kube-api-access-sb989\") pod \"ingress-canary-ggqmh\" (UID: \"6f21d298-2c6b-405e-bae4-30796db38eec\") " pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.310151 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.310135 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57h8t\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.380225 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.380185 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqmh" Jun 08 11:54:39.539142 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.539108 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqmh"] Jun 08 11:54:39.558822 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:54:39.558748 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f21d298_2c6b_405e_bae4_30796db38eec.slice/crio-14e8c91d962666eee0a03cef3ccbcd84c457ad15116b22ff376f18ed54dd9bed WatchSource:0}: Error finding container 14e8c91d962666eee0a03cef3ccbcd84c457ad15116b22ff376f18ed54dd9bed: Status 404 returned error can't find the container with id 14e8c91d962666eee0a03cef3ccbcd84c457ad15116b22ff376f18ed54dd9bed Jun 08 11:54:39.805031 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.804855 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:39.805183 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:39.805065 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:39.805183 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.805009 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:39.805183 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.805153 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:40.805137743 +0000 UTC m=+37.189826315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:39.805283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.805190 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:39.805283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.805200 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:39.805283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:39.805241 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:40.805230448 +0000 UTC m=+37.189919018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:54:40.264291 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:40.264258 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="a4daf7d3e16e8549715b22e0299b4de41daef2814bbdf5daff9c59eb8aef942c" exitCode=0 Jun 08 11:54:40.264754 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:40.264352 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"a4daf7d3e16e8549715b22e0299b4de41daef2814bbdf5daff9c59eb8aef942c"} Jun 08 11:54:40.265595 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:40.265565 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqmh" event={"ID":"6f21d298-2c6b-405e-bae4-30796db38eec","Type":"ContainerStarted","Data":"14e8c91d962666eee0a03cef3ccbcd84c457ad15116b22ff376f18ed54dd9bed"} Jun 08 11:54:40.812166 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:40.812130 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:40.812364 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:40.812189 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:40.812364 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:40.812294 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:40.812364 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:40.812314 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:40.812364 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:40.812336 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:40.812551 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:40.812368 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:42.812335961 +0000 UTC m=+39.197024532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:40.812551 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:40.812405 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:42.812384725 +0000 UTC m=+39.197073299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:54:41.272151 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:41.272114 2517 generic.go:356] "Generic (PLEG): container finished" podID="7ee3fc0e-a066-471f-a460-735882cd7ae3" containerID="320922287d96cd81d9ac6cc4d4b2f224ab93aff2f11da2254ea5219f6029f739" exitCode=0 Jun 08 11:54:41.272560 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:41.272159 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerDied","Data":"320922287d96cd81d9ac6cc4d4b2f224ab93aff2f11da2254ea5219f6029f739"} Jun 08 11:54:42.276167 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.276130 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqmh" event={"ID":"6f21d298-2c6b-405e-bae4-30796db38eec","Type":"ContainerStarted","Data":"ee29431027dea1423e5aa10d78bf4b92751fb2c42b420c6769844fd617d4b40e"} Jun 08 11:54:42.282874 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.282840 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b22hk" event={"ID":"7ee3fc0e-a066-471f-a460-735882cd7ae3","Type":"ContainerStarted","Data":"f2ca59906ea07946e58b59ccd69a4796b96af5a6bea47edf03db52a0fde7fc93"} Jun 08 11:54:42.296301 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.296254 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ggqmh" podStartSLOduration=1.074574551 podStartE2EDuration="3.296239925s" totalImagesPullingTime="2.221665374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:42.295213309 +0000 UTC m=+38.679901913" watchObservedRunningTime="2026-06-08 11:54:42.296239925 +0000 UTC m=+38.680928515" Jun 08 11:54:42.315556 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.315502 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b22hk" podStartSLOduration=8.484080708 podStartE2EDuration="38.315482585s" totalImagesPullingTime="29.831401877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:42.313930186 +0000 UTC m=+38.698618776" watchObservedRunningTime="2026-06-08 11:54:42.315482585 +0000 UTC m=+38.700171176" Jun 08 11:54:42.828964 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.828869 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:42.829131 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:42.828959 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:42.829131 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:42.829027 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:42.829131 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:42.829050 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:42.829131 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:42.829092 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:42.829131 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:42.829110 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:46.82909355 +0000 UTC m=+43.213782123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:54:42.829313 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:42.829154 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:46.829137776 +0000 UTC m=+43.213826358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:46.860889 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:46.860826 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:46.860932 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:46.860985 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:46.861078 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:54.861061313 +0000 UTC m=+51.245749885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:46.861076 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:46.861095 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:46.861441 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:46.861123 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:54.861112897 +0000 UTC m=+51.245801470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:54:54.918707 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:54.918665 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:54:54.918757 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:54.918827 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:54.918893 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:55:10.918875432 +0000 UTC m=+67.303564021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:54.918901 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:54.918916 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:54:54.919302 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:54:54.918972 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:55:10.918957139 +0000 UTC m=+67.303645723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:55:03.263316 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:03.263283 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w89bg" Jun 08 11:55:09.826917 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:09.826863 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:55:09.829464 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:09.829447 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 11:55:09.837392 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:09.837376 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 11:55:09.837461 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:09.837425 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:56:13.837410099 +0000 UTC m=+130.222098668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : secret "metrics-daemon-secret" not found Jun 08 11:55:09.927961 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:09.927921 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:55:09.930606 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:09.930587 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 11:55:09.941527 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:09.941511 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04bbd309-255e-4afe-8ab8-2d519b3d27df-original-pull-secret\") pod \"global-pull-secret-syncer-2z2lb\" (UID: \"04bbd309-255e-4afe-8ab8-2d519b3d27df\") " pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:55:10.019103 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.019067 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z2lb" Jun 08 11:55:10.028833 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.028811 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:55:10.031444 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.031423 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 11:55:10.041566 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.041543 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 11:55:10.051714 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.051683 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88hk\" (UniqueName: \"kubernetes.io/projected/aa485ad7-1705-4f82-8086-cae0fc0e1bea-kube-api-access-q88hk\") pod \"network-check-target-gbl27\" (UID: \"aa485ad7-1705-4f82-8086-cae0fc0e1bea\") " pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:55:10.143715 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.143159 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2z2lb"] Jun 08 11:55:10.148737 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:55:10.148702 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bbd309_255e_4afe_8ab8_2d519b3d27df.slice/crio-f336d4668a0e99e1dd9e07eee47ab825b5e0ee99dc3bd69de191053165aa50ca WatchSource:0}: Error finding container f336d4668a0e99e1dd9e07eee47ab825b5e0ee99dc3bd69de191053165aa50ca: Status 404 returned error can't find the container with id f336d4668a0e99e1dd9e07eee47ab825b5e0ee99dc3bd69de191053165aa50ca Jun 08 11:55:10.337759 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.337728 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7wfvl\"" Jun 08 11:55:10.345904 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.345881 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:55:10.349070 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.349043 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2z2lb" event={"ID":"04bbd309-255e-4afe-8ab8-2d519b3d27df","Type":"ContainerStarted","Data":"f336d4668a0e99e1dd9e07eee47ab825b5e0ee99dc3bd69de191053165aa50ca"} Jun 08 11:55:10.463664 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.463631 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbl27"] Jun 08 11:55:10.466654 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:55:10.466628 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa485ad7_1705_4f82_8086_cae0fc0e1bea.slice/crio-4043b9a3203b4308f869a66a4ac2a471c21f18bae2335e0993c92b3c3adcf245 WatchSource:0}: Error finding container 4043b9a3203b4308f869a66a4ac2a471c21f18bae2335e0993c92b3c3adcf245: Status 404 returned error can't find the container with id 4043b9a3203b4308f869a66a4ac2a471c21f18bae2335e0993c92b3c3adcf245 Jun 08 11:55:10.936156 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.936042 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:55:10.936156 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:10.936120 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:55:10.936694 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:10.936188 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:55:10.936694 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:10.936269 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:55:42.936243378 +0000 UTC m=+99.320931964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:55:10.936694 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:10.936279 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:55:10.936694 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:10.936295 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:55:10.936694 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:10.936381 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:55:42.936365973 +0000 UTC m=+99.321054554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:55:11.353847 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:11.353744 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbl27" event={"ID":"aa485ad7-1705-4f82-8086-cae0fc0e1bea","Type":"ContainerStarted","Data":"4043b9a3203b4308f869a66a4ac2a471c21f18bae2335e0993c92b3c3adcf245"} Jun 08 11:55:15.365561 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:15.365518 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2z2lb" event={"ID":"04bbd309-255e-4afe-8ab8-2d519b3d27df","Type":"ContainerStarted","Data":"7d7b795627cdf7cdf1d67acd338a2a318844d602d7b45a95e73cf556965c3c28"} Jun 08 11:55:15.366967 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:15.366948 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbl27" event={"ID":"aa485ad7-1705-4f82-8086-cae0fc0e1bea","Type":"ContainerStarted","Data":"be3b853d2025f4776e9ceb45e6d1de3d254dec7351dd1c04b1f7bb5be7c4eb25"} Jun 08 11:55:15.367086 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:15.367069 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:55:15.380864 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:15.380823 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2z2lb" podStartSLOduration=66.762592832 podStartE2EDuration="1m11.380812634s" totalImagesPullingTime="4.618219802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:55:15.38057345 +0000 UTC m=+71.765262041" watchObservedRunningTime="2026-06-08 11:55:15.380812634 +0000 UTC m=+71.765501225" Jun 08 11:55:15.397130 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:15.397094 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gbl27" podStartSLOduration=67.100042259 podStartE2EDuration="1m11.397082878s" totalImagesPullingTime="4.297040619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:55:15.396628687 +0000 UTC m=+71.781317278" watchObservedRunningTime="2026-06-08 11:55:15.397082878 +0000 UTC m=+71.781771463" Jun 08 11:55:23.106084 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.105974 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx"] Jun 08 11:55:23.107525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.107509 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.112103 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.112078 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7hc4s\"" Jun 08 11:55:23.112250 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.112228 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 11:55:23.113288 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.113081 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 11:55:23.113288 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.113270 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 11:55:23.114609 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.114590 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 11:55:23.124302 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.124280 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx"] Jun 08 11:55:23.228874 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.228838 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59076d61-5a96-41fc-9cf9-41e5a6de0e18-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.229026 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.228908 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4485\" (UniqueName: \"kubernetes.io/projected/59076d61-5a96-41fc-9cf9-41e5a6de0e18-kube-api-access-k4485\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.329643 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.329608 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59076d61-5a96-41fc-9cf9-41e5a6de0e18-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.329792 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.329684 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4485\" (UniqueName: \"kubernetes.io/projected/59076d61-5a96-41fc-9cf9-41e5a6de0e18-kube-api-access-k4485\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.332090 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.332071 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59076d61-5a96-41fc-9cf9-41e5a6de0e18-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.338007 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.337984 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4485\" (UniqueName: \"kubernetes.io/projected/59076d61-5a96-41fc-9cf9-41e5a6de0e18-kube-api-access-k4485\") pod \"managed-serviceaccount-addon-agent-6b599484d4-bpgkx\" (UID: \"59076d61-5a96-41fc-9cf9-41e5a6de0e18\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.425570 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.425541 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" Jun 08 11:55:23.543169 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:23.543136 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx"] Jun 08 11:55:23.546731 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:55:23.546706 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59076d61_5a96_41fc_9cf9_41e5a6de0e18.slice/crio-1e5f369229ca8acd0d314fc7b4bc2fa26cbbdcfb397bace3e9367fc12dc1772f WatchSource:0}: Error finding container 1e5f369229ca8acd0d314fc7b4bc2fa26cbbdcfb397bace3e9367fc12dc1772f: Status 404 returned error can't find the container with id 1e5f369229ca8acd0d314fc7b4bc2fa26cbbdcfb397bace3e9367fc12dc1772f Jun 08 11:55:24.390551 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:24.390508 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" event={"ID":"59076d61-5a96-41fc-9cf9-41e5a6de0e18","Type":"ContainerStarted","Data":"1e5f369229ca8acd0d314fc7b4bc2fa26cbbdcfb397bace3e9367fc12dc1772f"} Jun 08 11:55:26.396966 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:26.396929 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" event={"ID":"59076d61-5a96-41fc-9cf9-41e5a6de0e18","Type":"ContainerStarted","Data":"1953a89cb6549023973d20b25c309624c2b381313a88808775eaf4ff6f31b3b3"} Jun 08 11:55:26.412480 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:26.412432 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" podStartSLOduration=1.077871442 podStartE2EDuration="3.412417557s" totalImagesPullingTime="2.334546115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:55:26.411895623 +0000 UTC m=+82.796584213" watchObservedRunningTime="2026-06-08 11:55:26.412417557 +0000 UTC m=+82.797106147" Jun 08 11:55:42.969986 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:42.969954 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:42.970002 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:42.970122 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:42.970155 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:42.970172 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:42.970212 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:56:46.970188987 +0000 UTC m=+163.354877557 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:55:42.970418 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:55:42.970228 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:56:46.970221828 +0000 UTC m=+163.354910397 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:55:46.371666 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:55:46.371637 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gbl27" Jun 08 11:56:13.882672 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:13.882618 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:56:13.883167 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:13.882772 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 11:56:13.883167 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:13.882843 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:15.882824691 +0000 UTC m=+252.267513261 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : secret "metrics-daemon-secret" not found Jun 08 11:56:42.048327 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:42.048270 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" Jun 08 11:56:42.058389 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:42.058360 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nlwsj" podUID="3f7028b9-c116-490f-b863-8b6f3adb8d82" Jun 08 11:56:42.125373 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:42.125336 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:56:42.575247 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:42.575222 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:56:42.575404 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:42.575255 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:56:47.009464 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:47.009405 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:47.009548 2517 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:47.009614 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls podName:3f7028b9-c116-490f-b863-8b6f3adb8d82 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:49.009598041 +0000 UTC m=+285.394286610 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls") pod "dns-default-nlwsj" (UID: "3f7028b9-c116-490f-b863-8b6f3adb8d82") : secret "dns-default-metrics-tls" not found Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:47.009620 2517 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:47.009635 2517 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8b55c876-hjjg8: secret "image-registry-tls" not found Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:56:47.009685 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls podName:0639531b-7b10-43e5-ab00-6dfa3f724369 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:49.009673908 +0000 UTC m=+285.394362476 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls") pod "image-registry-7f8b55c876-hjjg8" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369") : secret "image-registry-tls" not found Jun 08 11:56:47.010068 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:47.009552 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:56:54.097435 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:56:54.097331 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:57:26.682912 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:26.682879 2517 generic.go:356] "Generic (PLEG): container finished" podID="59076d61-5a96-41fc-9cf9-41e5a6de0e18" containerID="1953a89cb6549023973d20b25c309624c2b381313a88808775eaf4ff6f31b3b3" exitCode=255 Jun 08 11:57:26.683319 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:26.682937 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" event={"ID":"59076d61-5a96-41fc-9cf9-41e5a6de0e18","Type":"ContainerDied","Data":"1953a89cb6549023973d20b25c309624c2b381313a88808775eaf4ff6f31b3b3"} Jun 08 11:57:26.688494 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:26.688475 2517 scope.go:117] "RemoveContainer" containerID="1953a89cb6549023973d20b25c309624c2b381313a88808775eaf4ff6f31b3b3" Jun 08 11:57:27.687954 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:27.687917 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b599484d4-bpgkx" event={"ID":"59076d61-5a96-41fc-9cf9-41e5a6de0e18","Type":"ContainerStarted","Data":"e1b3a9fdb15e6ba55fea5123a08e98ba094cc3bbf0a9497f87b06827430310e4"} Jun 08 11:57:59.191358 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.191316 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-n7mhp"] Jun 08 11:57:59.194221 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.194200 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.196830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.196771 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xqscp\"" Jun 08 11:57:59.196830 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.196796 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 11:57:59.197043 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.196913 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 11:57:59.197043 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.196936 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 11:57:59.205316 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.205299 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 11:57:59.207071 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.207048 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x"] Jun 08 11:57:59.209799 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.209784 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.212123 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212097 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-trusted-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.212248 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212135 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rcsm\" (UniqueName: \"kubernetes.io/projected/e23505ba-9475-46d9-af7b-22b07c542d22-kube-api-access-4rcsm\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.212248 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212165 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-snapshots\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.212248 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212199 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-tmp\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.212248 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212215 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e23505ba-9475-46d9-af7b-22b07c542d22-serving-cert\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.212514 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.212381 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-service-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.216609 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.216589 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 11:57:59.218938 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.218924 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 11:57:59.219001 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.218964 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 11:57:59.219126 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.219114 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 11:57:59.219172 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.219126 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4cxhv\"" Jun 08 11:57:59.220673 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.220659 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 11:57:59.226984 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.226960 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-n7mhp"] Jun 08 11:57:59.243207 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.243186 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x"] Jun 08 11:57:59.294002 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.293976 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb"] Jun 08 11:57:59.297113 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.297095 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" Jun 08 11:57:59.298740 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.298719 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np"] Jun 08 11:57:59.299620 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.299594 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 11:57:59.299620 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.299604 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5dknl\"" Jun 08 11:57:59.300080 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.300065 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 11:57:59.301437 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.301417 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j"] Jun 08 11:57:59.301563 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.301546 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.303810 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.303793 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p9rdv\"" Jun 08 11:57:59.303894 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.303880 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 11:57:59.304598 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.304396 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc"] Jun 08 11:57:59.305022 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.305001 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.308981 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.308962 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 11:57:59.309404 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.309385 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 11:57:59.309821 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.309641 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 11:57:59.311320 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.310872 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 11:57:59.311320 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.310924 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" Jun 08 11:57:59.311320 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.311115 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 11:57:59.311320 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.311213 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb"] Jun 08 11:57:59.311320 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.311293 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tc7ks\"" Jun 08 11:57:59.312730 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312703 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sr5w\" (UniqueName: \"kubernetes.io/projected/6b168690-c2a7-456d-9abc-fc3d146411ed-kube-api-access-6sr5w\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.312831 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312751 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56574e26-6d98-45a9-83fb-a8c475847226-config\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.312831 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312794 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46sxc\" (UniqueName: \"kubernetes.io/projected/56574e26-6d98-45a9-83fb-a8c475847226-kube-api-access-46sxc\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312854 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312889 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-trusted-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312935 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56574e26-6d98-45a9-83fb-a8c475847226-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.312973 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/559652cd-a785-43e2-b4a2-883aa3bdc5e2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313005 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-tmp\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.313049 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313041 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313082 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-service-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313166 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-snapshots\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313193 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd7bv\" (UniqueName: \"kubernetes.io/projected/21faab80-2ec7-4a98-84fc-99011dab2caf-kube-api-access-sd7bv\") pod \"volume-data-source-validator-78dd696465-qdqvb\" (UID: \"21faab80-2ec7-4a98-84fc-99011dab2caf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313222 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6b168690-c2a7-456d-9abc-fc3d146411ed-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313250 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rcsm\" (UniqueName: \"kubernetes.io/projected/e23505ba-9475-46d9-af7b-22b07c542d22-kube-api-access-4rcsm\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.313403 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313290 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e23505ba-9475-46d9-af7b-22b07c542d22-serving-cert\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.314115 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313972 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-tmp\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.314115 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313970 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-service-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.314115 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.313998 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e23505ba-9475-46d9-af7b-22b07c542d22-trusted-ca-bundle\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.314520 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.314494 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e23505ba-9475-46d9-af7b-22b07c542d22-snapshots\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.315777 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.315757 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-csld2\"" Jun 08 11:57:59.316824 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.316724 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e23505ba-9475-46d9-af7b-22b07c542d22-serving-cert\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.316824 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.316766 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np"] Jun 08 11:57:59.317420 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.317399 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j"] Jun 08 11:57:59.335845 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.335825 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc"] Jun 08 11:57:59.337937 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.337913 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rcsm\" (UniqueName: \"kubernetes.io/projected/e23505ba-9475-46d9-af7b-22b07c542d22-kube-api-access-4rcsm\") pod \"insights-operator-896549976-n7mhp\" (UID: \"e23505ba-9475-46d9-af7b-22b07c542d22\") " pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.388752 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.388723 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr"] Jun 08 11:57:59.392735 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.392719 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.395120 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.395098 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 11:57:59.395219 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.395146 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 11:57:59.395219 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.395159 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 11:57:59.395318 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.395249 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 11:57:59.395318 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.395255 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j8vb8\"" Jun 08 11:57:59.401575 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.401557 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr"] Jun 08 11:57:59.414389 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414369 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sr5w\" (UniqueName: \"kubernetes.io/projected/6b168690-c2a7-456d-9abc-fc3d146411ed-kube-api-access-6sr5w\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.414476 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414401 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56574e26-6d98-45a9-83fb-a8c475847226-config\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.414476 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414419 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46sxc\" (UniqueName: \"kubernetes.io/projected/56574e26-6d98-45a9-83fb-a8c475847226-kube-api-access-46sxc\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.414546 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414539 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.414580 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414566 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d977d\" (UniqueName: \"kubernetes.io/projected/cd1ca8a0-1604-4918-93b9-cc5fd223ac67-kube-api-access-d977d\") pod \"network-check-source-dbd9cf844-mxlzc\" (UID: \"cd1ca8a0-1604-4918-93b9-cc5fd223ac67\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" Jun 08 11:57:59.414616 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414583 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56574e26-6d98-45a9-83fb-a8c475847226-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.414616 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414604 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/559652cd-a785-43e2-b4a2-883aa3bdc5e2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.414697 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414626 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtnh\" (UniqueName: \"kubernetes.io/projected/7891aeda-35a2-406b-870d-a527867dcd77-kube-api-access-6gtnh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.414697 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414648 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.414794 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.414717 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:57:59.414794 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414731 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd7bv\" (UniqueName: \"kubernetes.io/projected/21faab80-2ec7-4a98-84fc-99011dab2caf-kube-api-access-sd7bv\") pod \"volume-data-source-validator-78dd696465-qdqvb\" (UID: \"21faab80-2ec7-4a98-84fc-99011dab2caf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" Jun 08 11:57:59.414794 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.414736 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:57:59.414794 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.414766 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:57:59.914749714 +0000 UTC m=+236.299438283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:57:59.414999 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414795 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6b168690-c2a7-456d-9abc-fc3d146411ed-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.414999 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.414806 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:57:59.914788376 +0000 UTC m=+236.299476945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:57:59.414999 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414839 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7891aeda-35a2-406b-870d-a527867dcd77-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.414999 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.414890 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7891aeda-35a2-406b-870d-a527867dcd77-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.415215 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.415129 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56574e26-6d98-45a9-83fb-a8c475847226-config\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.415387 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.415368 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6b168690-c2a7-456d-9abc-fc3d146411ed-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.415444 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.415370 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/559652cd-a785-43e2-b4a2-883aa3bdc5e2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.416773 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.416753 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56574e26-6d98-45a9-83fb-a8c475847226-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.423324 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.423304 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sr5w\" (UniqueName: \"kubernetes.io/projected/6b168690-c2a7-456d-9abc-fc3d146411ed-kube-api-access-6sr5w\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.423441 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.423402 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46sxc\" (UniqueName: \"kubernetes.io/projected/56574e26-6d98-45a9-83fb-a8c475847226-kube-api-access-46sxc\") pod \"service-ca-operator-6bc5ff68f5-4w9np\" (UID: \"56574e26-6d98-45a9-83fb-a8c475847226\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.423717 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.423699 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd7bv\" (UniqueName: \"kubernetes.io/projected/21faab80-2ec7-4a98-84fc-99011dab2caf-kube-api-access-sd7bv\") pod \"volume-data-source-validator-78dd696465-qdqvb\" (UID: \"21faab80-2ec7-4a98-84fc-99011dab2caf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" Jun 08 11:57:59.502844 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.502758 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-n7mhp" Jun 08 11:57:59.515515 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.515479 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7891aeda-35a2-406b-870d-a527867dcd77-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.515643 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.515550 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7891aeda-35a2-406b-870d-a527867dcd77-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.515703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.515643 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d977d\" (UniqueName: \"kubernetes.io/projected/cd1ca8a0-1604-4918-93b9-cc5fd223ac67-kube-api-access-d977d\") pod \"network-check-source-dbd9cf844-mxlzc\" (UID: \"cd1ca8a0-1604-4918-93b9-cc5fd223ac67\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" Jun 08 11:57:59.515703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.515680 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtnh\" (UniqueName: \"kubernetes.io/projected/7891aeda-35a2-406b-870d-a527867dcd77-kube-api-access-6gtnh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.515945 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.515926 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7891aeda-35a2-406b-870d-a527867dcd77-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.517646 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.517626 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7891aeda-35a2-406b-870d-a527867dcd77-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.527586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.527562 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtnh\" (UniqueName: \"kubernetes.io/projected/7891aeda-35a2-406b-870d-a527867dcd77-kube-api-access-6gtnh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wfmqr\" (UID: \"7891aeda-35a2-406b-870d-a527867dcd77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.527869 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.527853 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d977d\" (UniqueName: \"kubernetes.io/projected/cd1ca8a0-1604-4918-93b9-cc5fd223ac67-kube-api-access-d977d\") pod \"network-check-source-dbd9cf844-mxlzc\" (UID: \"cd1ca8a0-1604-4918-93b9-cc5fd223ac67\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" Jun 08 11:57:59.608642 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.608605 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" Jun 08 11:57:59.617849 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.617825 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" Jun 08 11:57:59.625271 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.625247 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-n7mhp"] Jun 08 11:57:59.628993 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:57:59.628962 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23505ba_9475_46d9_af7b_22b07c542d22.slice/crio-e7e392316a890581a66059a7add2f9b73a76e10031cb4528d05c8f3a42e00858 WatchSource:0}: Error finding container e7e392316a890581a66059a7add2f9b73a76e10031cb4528d05c8f3a42e00858: Status 404 returned error can't find the container with id e7e392316a890581a66059a7add2f9b73a76e10031cb4528d05c8f3a42e00858 Jun 08 11:57:59.633888 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.633857 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" Jun 08 11:57:59.701838 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.701805 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" Jun 08 11:57:59.759502 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.759158 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb"] Jun 08 11:57:59.764244 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:57:59.764202 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21faab80_2ec7_4a98_84fc_99011dab2caf.slice/crio-fd37b8802c203852bf9acd4a5c73829c6ae132acb5b80fa51bb7cbde40318ff3 WatchSource:0}: Error finding container fd37b8802c203852bf9acd4a5c73829c6ae132acb5b80fa51bb7cbde40318ff3: Status 404 returned error can't find the container with id fd37b8802c203852bf9acd4a5c73829c6ae132acb5b80fa51bb7cbde40318ff3 Jun 08 11:57:59.777951 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.777926 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np"] Jun 08 11:57:59.780799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:57:59.780773 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56574e26_6d98_45a9_83fb_a8c475847226.slice/crio-9cb52d86519c20fc43dfacb3b7710cd97aa0caf8fcb885ef8bd92486f18ba6c0 WatchSource:0}: Error finding container 9cb52d86519c20fc43dfacb3b7710cd97aa0caf8fcb885ef8bd92486f18ba6c0: Status 404 returned error can't find the container with id 9cb52d86519c20fc43dfacb3b7710cd97aa0caf8fcb885ef8bd92486f18ba6c0 Jun 08 11:57:59.784396 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.784370 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" event={"ID":"21faab80-2ec7-4a98-84fc-99011dab2caf","Type":"ContainerStarted","Data":"fd37b8802c203852bf9acd4a5c73829c6ae132acb5b80fa51bb7cbde40318ff3"} Jun 08 11:57:59.785514 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.785493 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-n7mhp" event={"ID":"e23505ba-9475-46d9-af7b-22b07c542d22","Type":"ContainerStarted","Data":"e7e392316a890581a66059a7add2f9b73a76e10031cb4528d05c8f3a42e00858"} Jun 08 11:57:59.790586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.790564 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc"] Jun 08 11:57:59.795670 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:57:59.795643 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1ca8a0_1604_4918_93b9_cc5fd223ac67.slice/crio-210d4d5c05e50280abc1e6b6f3241ac927c1738bd00de1bb062e5d5ebf32c051 WatchSource:0}: Error finding container 210d4d5c05e50280abc1e6b6f3241ac927c1738bd00de1bb062e5d5ebf32c051: Status 404 returned error can't find the container with id 210d4d5c05e50280abc1e6b6f3241ac927c1738bd00de1bb062e5d5ebf32c051 Jun 08 11:57:59.838916 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.838894 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr"] Jun 08 11:57:59.841690 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:57:59.841661 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7891aeda_35a2_406b_870d_a527867dcd77.slice/crio-7a122ca2e8d9d9113a54b51bdbee3a93a34c7ef623ab027a8c22f25896456d6c WatchSource:0}: Error finding container 7a122ca2e8d9d9113a54b51bdbee3a93a34c7ef623ab027a8c22f25896456d6c: Status 404 returned error can't find the container with id 7a122ca2e8d9d9113a54b51bdbee3a93a34c7ef623ab027a8c22f25896456d6c Jun 08 11:57:59.919125 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.919096 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:57:59.919288 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:57:59.919143 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:57:59.919288 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.919248 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:57:59.919288 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.919263 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:57:59.919420 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.919304 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:58:00.919286788 +0000 UTC m=+237.303975358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:57:59.919420 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:57:59.919326 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:00.919308985 +0000 UTC m=+237.303997563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:58:00.792167 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.792123 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" event={"ID":"7891aeda-35a2-406b-870d-a527867dcd77","Type":"ContainerStarted","Data":"7a122ca2e8d9d9113a54b51bdbee3a93a34c7ef623ab027a8c22f25896456d6c"} Jun 08 11:58:00.794202 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.794122 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" event={"ID":"cd1ca8a0-1604-4918-93b9-cc5fd223ac67","Type":"ContainerStarted","Data":"972a76d5ff455354636de6a749438b99c73fe6ebfe1b97975dfed693a962b99a"} Jun 08 11:58:00.794202 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.794169 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" event={"ID":"cd1ca8a0-1604-4918-93b9-cc5fd223ac67","Type":"ContainerStarted","Data":"210d4d5c05e50280abc1e6b6f3241ac927c1738bd00de1bb062e5d5ebf32c051"} Jun 08 11:58:00.796099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.796060 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" event={"ID":"56574e26-6d98-45a9-83fb-a8c475847226","Type":"ContainerStarted","Data":"9cb52d86519c20fc43dfacb3b7710cd97aa0caf8fcb885ef8bd92486f18ba6c0"} Jun 08 11:58:00.811602 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.811553 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mxlzc" podStartSLOduration=1.811532645 podStartE2EDuration="1.811532645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:00.809720346 +0000 UTC m=+237.194408916" watchObservedRunningTime="2026-06-08 11:58:00.811532645 +0000 UTC m=+237.196221237" Jun 08 11:58:00.927715 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.927680 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:00.927902 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:00.927828 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:00.927902 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:00.927843 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:58:00.928046 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:00.927918 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:02.927895726 +0000 UTC m=+239.312584317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:58:00.928046 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:00.927964 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:00.928046 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:00.928015 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:58:02.927999643 +0000 UTC m=+239.312688219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:02.945857 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:02.945812 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:02.946283 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:02.945951 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:02.946283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:02.946003 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:02.946283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:02.946063 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:58:02.946283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:02.946080 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:58:06.946056905 +0000 UTC m=+243.330745487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:02.946283 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:02.946111 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:06.946095558 +0000 UTC m=+243.330784127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:58:03.812381 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.812321 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-n7mhp" event={"ID":"e23505ba-9475-46d9-af7b-22b07c542d22","Type":"ContainerStarted","Data":"dfc8c95e9e9f42f08e4dfccf490417f93ce02415163f61e2e17ff25519353a39"} Jun 08 11:58:03.814039 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.814008 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" event={"ID":"7891aeda-35a2-406b-870d-a527867dcd77","Type":"ContainerStarted","Data":"13961efa2608e3f6f7a7de9bf2dcbf0c71222c87fa509cc3e18d92f349bc89d0"} Jun 08 11:58:03.815526 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.815496 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" event={"ID":"56574e26-6d98-45a9-83fb-a8c475847226","Type":"ContainerStarted","Data":"7239a92615cd7dd6f9b8d05e4b761ecb376d0881313d455cf5cb8ed019bc0a62"} Jun 08 11:58:03.817067 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.817046 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" event={"ID":"21faab80-2ec7-4a98-84fc-99011dab2caf","Type":"ContainerStarted","Data":"b789dbfbd9dc104342b97d35829abaa4f3b4fe2e08e3f9edf8961898c8ead76c"} Jun 08 11:58:03.829676 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.829626 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-n7mhp" podStartSLOduration=1.613176579 podStartE2EDuration="4.829601801s" totalImagesPullingTime="3.216425222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:03.829455967 +0000 UTC m=+240.214144559" watchObservedRunningTime="2026-06-08 11:58:03.829601801 +0000 UTC m=+240.214290394" Jun 08 11:58:03.862182 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.862119 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" podStartSLOduration=1.854832241 podStartE2EDuration="4.862104041s" totalImagesPullingTime="3.0072718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:03.86121793 +0000 UTC m=+240.245906522" watchObservedRunningTime="2026-06-08 11:58:03.862104041 +0000 UTC m=+240.246792631" Jun 08 11:58:03.862440 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:03.862413 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" podStartSLOduration=1.7918225749999999 podStartE2EDuration="4.86240714s" totalImagesPullingTime="3.070584565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:03.844524366 +0000 UTC m=+240.229212960" watchObservedRunningTime="2026-06-08 11:58:03.86240714 +0000 UTC m=+240.247095737" Jun 08 11:58:05.703895 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:05.703865 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-64947_f6af153f-e31d-4b1f-a657-b3a503a0fc6e/dns-node-resolver/0.log" Jun 08 11:58:06.703429 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:06.703404 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f7r5_4339b76c-e12e-4cdc-8dac-bd49d618f7a8/node-ca/0.log" Jun 08 11:58:06.978109 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:06.978018 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:06.978109 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:06.978101 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:06.978587 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:06.978193 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:58:06.978587 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:06.978201 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:06.978587 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:06.978252 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:14.978236582 +0000 UTC m=+251.362925150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:58:06.978587 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:06.978282 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:58:14.978262719 +0000 UTC m=+251.362951304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:07.705289 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:07.705259 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqmh_6f21d298-2c6b-405e-bae4-30796db38eec/serve-healthcheck-canary/0.log" Jun 08 11:58:15.043914 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:15.043875 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:15.044385 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:15.043998 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:15.044385 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.044024 2517 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:15.044385 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.044095 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls podName:6b168690-c2a7-456d-9abc-fc3d146411ed nodeName:}" failed. No retries permitted until 2026-06-08 11:58:31.044079774 +0000 UTC m=+267.428768343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m5t7x" (UID: "6b168690-c2a7-456d-9abc-fc3d146411ed") : secret "cluster-monitoring-operator-tls" not found Jun 08 11:58:15.044385 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.044110 2517 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 11:58:15.044385 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.044161 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert podName:559652cd-a785-43e2-b4a2-883aa3bdc5e2 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:31.044144516 +0000 UTC m=+267.428833090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-wlm6j" (UID: "559652cd-a785-43e2-b4a2-883aa3bdc5e2") : secret "networking-console-plugin-cert" not found Jun 08 11:58:15.951236 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:15.951204 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:58:15.951427 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.951370 2517 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 11:58:15.951474 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:15.951431 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs podName:7031fce5-b92d-4dc3-a5cf-ac1dbf238b90 nodeName:}" failed. No retries permitted until 2026-06-08 12:00:17.951411846 +0000 UTC m=+374.336100433 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs") pod "network-metrics-daemon-vhzrt" (UID: "7031fce5-b92d-4dc3-a5cf-ac1dbf238b90") : secret "metrics-daemon-secret" not found Jun 08 11:58:27.363397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.363294 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qdqvb" podStartSLOduration=25.284465355 podStartE2EDuration="28.36327535s" totalImagesPullingTime="3.078809995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:03.878098565 +0000 UTC m=+240.262787157" watchObservedRunningTime="2026-06-08 11:58:27.36327535 +0000 UTC m=+263.747963940" Jun 08 11:58:27.364044 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.364026 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rlbmh"] Jun 08 11:58:27.367286 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.367265 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.370768 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.370750 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 11:58:27.371738 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.371718 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9z6zt\"" Jun 08 11:58:27.371824 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.371740 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 11:58:27.381835 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.381814 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-7d4tr"] Jun 08 11:58:27.384660 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.384642 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlbmh"] Jun 08 11:58:27.384753 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.384741 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:27.387035 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.387016 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 11:58:27.387850 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.387833 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 11:58:27.388166 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.387927 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xl85b\"" Jun 08 11:58:27.398589 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.398557 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-7d4tr"] Jun 08 11:58:27.445394 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.445358 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e338af3-d254-47e2-953b-351060b988a3-data-volume\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.445541 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.445471 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8sz\" (UniqueName: \"kubernetes.io/projected/3e338af3-d254-47e2-953b-351060b988a3-kube-api-access-wc8sz\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.445541 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.445510 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e338af3-d254-47e2-953b-351060b988a3-crio-socket\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.445541 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.445534 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e338af3-d254-47e2-953b-351060b988a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.445772 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.445642 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e338af3-d254-47e2-953b-351060b988a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546393 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546366 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8sz\" (UniqueName: \"kubernetes.io/projected/3e338af3-d254-47e2-953b-351060b988a3-kube-api-access-wc8sz\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546393 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546400 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8sx2\" (UniqueName: \"kubernetes.io/projected/a333f3bc-7324-4931-be86-33d578070989-kube-api-access-l8sx2\") pod \"downloads-6657875f97-7d4tr\" (UID: \"a333f3bc-7324-4931-be86-33d578070989\") " pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:27.546588 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546525 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e338af3-d254-47e2-953b-351060b988a3-crio-socket\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546588 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546566 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e338af3-d254-47e2-953b-351060b988a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546656 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546621 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e338af3-d254-47e2-953b-351060b988a3-crio-socket\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546656 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546632 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e338af3-d254-47e2-953b-351060b988a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.546718 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.546681 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e338af3-d254-47e2-953b-351060b988a3-data-volume\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.547014 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.547000 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e338af3-d254-47e2-953b-351060b988a3-data-volume\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.547218 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.547203 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e338af3-d254-47e2-953b-351060b988a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.548996 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.548970 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e338af3-d254-47e2-953b-351060b988a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.557920 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.557898 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8sz\" (UniqueName: \"kubernetes.io/projected/3e338af3-d254-47e2-953b-351060b988a3-kube-api-access-wc8sz\") pod \"insights-runtime-extractor-rlbmh\" (UID: \"3e338af3-d254-47e2-953b-351060b988a3\") " pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.647843 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.647818 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8sx2\" (UniqueName: \"kubernetes.io/projected/a333f3bc-7324-4931-be86-33d578070989-kube-api-access-l8sx2\") pod \"downloads-6657875f97-7d4tr\" (UID: \"a333f3bc-7324-4931-be86-33d578070989\") " pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:27.660429 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.660394 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8sx2\" (UniqueName: \"kubernetes.io/projected/a333f3bc-7324-4931-be86-33d578070989-kube-api-access-l8sx2\") pod \"downloads-6657875f97-7d4tr\" (UID: \"a333f3bc-7324-4931-be86-33d578070989\") " pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:27.675631 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.675603 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlbmh" Jun 08 11:58:27.694130 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.694104 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:27.813727 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.813687 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlbmh"] Jun 08 11:58:27.816019 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:27.815996 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e338af3_d254_47e2_953b_351060b988a3.slice/crio-74e84c82f810fc0f54886e76c54571d5a4bf55f5fc70299d6ed50c059d78da2b WatchSource:0}: Error finding container 74e84c82f810fc0f54886e76c54571d5a4bf55f5fc70299d6ed50c059d78da2b: Status 404 returned error can't find the container with id 74e84c82f810fc0f54886e76c54571d5a4bf55f5fc70299d6ed50c059d78da2b Jun 08 11:58:27.828474 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.828452 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-7d4tr"] Jun 08 11:58:27.831123 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:27.831094 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda333f3bc_7324_4931_be86_33d578070989.slice/crio-33c6801c2f9621cf3c92ebd844c0d9d2ead10a571e6ed499ad2ca16b64faa54e WatchSource:0}: Error finding container 33c6801c2f9621cf3c92ebd844c0d9d2ead10a571e6ed499ad2ca16b64faa54e: Status 404 returned error can't find the container with id 33c6801c2f9621cf3c92ebd844c0d9d2ead10a571e6ed499ad2ca16b64faa54e Jun 08 11:58:27.889776 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.889660 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlbmh" event={"ID":"3e338af3-d254-47e2-953b-351060b988a3","Type":"ContainerStarted","Data":"4e0096bf9bdaf3b4c3e34209d250b6a7c804da7d2da53229b6715a39c258e48a"} Jun 08 11:58:27.889776 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.889734 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlbmh" event={"ID":"3e338af3-d254-47e2-953b-351060b988a3","Type":"ContainerStarted","Data":"74e84c82f810fc0f54886e76c54571d5a4bf55f5fc70299d6ed50c059d78da2b"} Jun 08 11:58:27.890968 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:27.890947 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-7d4tr" event={"ID":"a333f3bc-7324-4931-be86-33d578070989","Type":"ContainerStarted","Data":"33c6801c2f9621cf3c92ebd844c0d9d2ead10a571e6ed499ad2ca16b64faa54e"} Jun 08 11:58:28.896139 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:28.896053 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlbmh" event={"ID":"3e338af3-d254-47e2-953b-351060b988a3","Type":"ContainerStarted","Data":"e8d6097a7a5dbb7825b114dcec019283b5efa15302f3c0299a61b0a44acb013c"} Jun 08 11:58:30.905631 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:30.905587 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlbmh" event={"ID":"3e338af3-d254-47e2-953b-351060b988a3","Type":"ContainerStarted","Data":"f248f8deed8ded46d0b16de38973c6fc78e44302ea44b1d10ac9708d7efaa019"} Jun 08 11:58:30.924620 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:30.924475 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rlbmh" podStartSLOduration=1.7344279249999999 podStartE2EDuration="3.924455616s" totalImagesPullingTime="2.190027691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:30.924292315 +0000 UTC m=+267.308980919" watchObservedRunningTime="2026-06-08 11:58:30.924455616 +0000 UTC m=+267.309144208" Jun 08 11:58:31.077526 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.077470 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:31.077729 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.077541 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:31.080229 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.080203 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/559652cd-a785-43e2-b4a2-883aa3bdc5e2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-wlm6j\" (UID: \"559652cd-a785-43e2-b4a2-883aa3bdc5e2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:31.080229 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.080226 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b168690-c2a7-456d-9abc-fc3d146411ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m5t7x\" (UID: \"6b168690-c2a7-456d-9abc-fc3d146411ed\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:31.131790 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.131760 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tc7ks\"" Jun 08 11:58:31.139649 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.139619 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" Jun 08 11:58:31.283292 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.283253 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j"] Jun 08 11:58:31.286255 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:31.286231 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559652cd_a785_43e2_b4a2_883aa3bdc5e2.slice/crio-71e67fc2a399c945d753bd2a4f665cac252abecb6cfb74dea37023e8098899f2 WatchSource:0}: Error finding container 71e67fc2a399c945d753bd2a4f665cac252abecb6cfb74dea37023e8098899f2: Status 404 returned error can't find the container with id 71e67fc2a399c945d753bd2a4f665cac252abecb6cfb74dea37023e8098899f2 Jun 08 11:58:31.320562 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.320537 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4cxhv\"" Jun 08 11:58:31.328723 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.328700 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" Jun 08 11:58:31.488905 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.488828 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x"] Jun 08 11:58:31.492226 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:31.492196 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b168690_c2a7_456d_9abc_fc3d146411ed.slice/crio-77e2f3fbb2a34eba63e5bff89c4dcded693b0b38027d692a80825425f3581292 WatchSource:0}: Error finding container 77e2f3fbb2a34eba63e5bff89c4dcded693b0b38027d692a80825425f3581292: Status 404 returned error can't find the container with id 77e2f3fbb2a34eba63e5bff89c4dcded693b0b38027d692a80825425f3581292 Jun 08 11:58:31.909941 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.909900 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" event={"ID":"559652cd-a785-43e2-b4a2-883aa3bdc5e2","Type":"ContainerStarted","Data":"71e67fc2a399c945d753bd2a4f665cac252abecb6cfb74dea37023e8098899f2"} Jun 08 11:58:31.911116 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:31.911089 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" event={"ID":"6b168690-c2a7-456d-9abc-fc3d146411ed","Type":"ContainerStarted","Data":"77e2f3fbb2a34eba63e5bff89c4dcded693b0b38027d692a80825425f3581292"} Jun 08 11:58:32.917665 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:32.917628 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" event={"ID":"559652cd-a785-43e2-b4a2-883aa3bdc5e2","Type":"ContainerStarted","Data":"54c037bbd22755df036d4ebf9da3c5d01649d8beaa4557c8eac6adc79f6133a3"} Jun 08 11:58:32.934577 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:32.934510 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-wlm6j" podStartSLOduration=32.528919513 podStartE2EDuration="33.934489573s" totalImagesPullingTime="1.40557006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:32.934046562 +0000 UTC m=+269.318735166" watchObservedRunningTime="2026-06-08 11:58:32.934489573 +0000 UTC m=+269.319178165" Jun 08 11:58:33.237603 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.237479 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:58:33.242146 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.242120 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.244809 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.244784 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 11:58:33.246299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.246052 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 11:58:33.246299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.246101 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 11:58:33.246299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.246163 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4z5l5\"" Jun 08 11:58:33.246299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.246104 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 11:58:33.246299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.246107 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 11:58:33.252443 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.252405 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:58:33.399027 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399001 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.399129 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399065 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.399129 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399090 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.399234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399136 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcd9k\" (UniqueName: \"kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.399234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399214 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.399325 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.399267 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500434 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500365 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500434 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500421 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500463 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500509 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500532 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.500639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.500587 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcd9k\" (UniqueName: \"kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.501198 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.501111 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.501857 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.501832 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.501990 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.501874 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.503986 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.503946 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.504092 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.503987 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.511289 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.511247 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcd9k\" (UniqueName: \"kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k\") pod \"console-67bd948f87-5f4rw\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.555332 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.555265 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:33.711639 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.711609 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:58:33.714875 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:33.714847 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8c3d33_9fd6_4d8c_9356_9133ec18aa1c.slice/crio-9169a73149ac4fb82fcf8a2f125c3072f3f0b9c459fa4fdd3f5367c524351353 WatchSource:0}: Error finding container 9169a73149ac4fb82fcf8a2f125c3072f3f0b9c459fa4fdd3f5367c524351353: Status 404 returned error can't find the container with id 9169a73149ac4fb82fcf8a2f125c3072f3f0b9c459fa4fdd3f5367c524351353 Jun 08 11:58:33.905075 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.905041 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt"] Jun 08 11:58:33.909465 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.909441 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:33.912204 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.912179 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 11:58:33.912323 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.912223 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kc9mr\"" Jun 08 11:58:33.916653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.916286 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt"] Jun 08 11:58:33.924546 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.924513 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd948f87-5f4rw" event={"ID":"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c","Type":"ContainerStarted","Data":"9169a73149ac4fb82fcf8a2f125c3072f3f0b9c459fa4fdd3f5367c524351353"} Jun 08 11:58:33.926761 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.926732 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" event={"ID":"6b168690-c2a7-456d-9abc-fc3d146411ed","Type":"ContainerStarted","Data":"fe34e88a1cd95fea8fe42e0d99a1d068f415313a4e960176d4648f878dea4189"} Jun 08 11:58:33.941800 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:33.941753 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m5t7x" podStartSLOduration=33.036983075 podStartE2EDuration="34.941737787s" totalImagesPullingTime="1.904754712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:33.941194005 +0000 UTC m=+270.325882597" watchObservedRunningTime="2026-06-08 11:58:33.941737787 +0000 UTC m=+270.326426380" Jun 08 11:58:34.006096 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.006063 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lmwgt\" (UID: \"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:34.107277 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.107121 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lmwgt\" (UID: \"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:34.107605 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:34.107580 2517 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 11:58:34.107716 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:34.107646 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates podName:c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:34.607628459 +0000 UTC m=+270.992317031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-lmwgt" (UID: "c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 11:58:34.612169 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.612131 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lmwgt\" (UID: \"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:34.614837 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.614810 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lmwgt\" (UID: \"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:34.823186 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.823151 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:34.970888 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:34.970835 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt"] Jun 08 11:58:34.974380 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:34.974331 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75ac4cc_ed4f_4a09_91c6_a78d184bcfb4.slice/crio-86621622a68d139c0b4ee1d85f54b4c9ad6e66c460b78e0a35dfb6987201360c WatchSource:0}: Error finding container 86621622a68d139c0b4ee1d85f54b4c9ad6e66c460b78e0a35dfb6987201360c: Status 404 returned error can't find the container with id 86621622a68d139c0b4ee1d85f54b4c9ad6e66c460b78e0a35dfb6987201360c Jun 08 11:58:35.935919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:35.935879 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" event={"ID":"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4","Type":"ContainerStarted","Data":"86621622a68d139c0b4ee1d85f54b4c9ad6e66c460b78e0a35dfb6987201360c"} Jun 08 11:58:39.639908 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.639868 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:58:39.642459 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.642436 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.654158 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.654127 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 11:58:39.654706 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.654674 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.654818 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.654713 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.654818 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.654752 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.654936 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.654891 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.655035 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.655016 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.655104 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.655062 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdlt\" (UniqueName: \"kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.655178 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.655128 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.656028 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.656004 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:58:39.756168 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756132 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756373 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756205 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756373 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756265 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756373 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756300 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdlt\" (UniqueName: \"kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756373 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756332 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756559 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756386 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.756559 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.756407 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.757199 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.757162 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.757433 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.757386 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.757554 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.757530 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.757619 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.757570 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.759169 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.759146 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.759493 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.759469 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.764846 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.764827 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdlt\" (UniqueName: \"kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt\") pod \"console-6cf7b66b54-q7kdb\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:39.953742 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:39.953705 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:44.703125 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.703098 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:58:44.709560 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:44.709532 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ff4b68_72dd_4894_a06c_1a617f6ae34e.slice/crio-a8987dc83332d3ca6a74e61c7572839a42a97aef21941d23a66a1ce557fa10fd WatchSource:0}: Error finding container a8987dc83332d3ca6a74e61c7572839a42a97aef21941d23a66a1ce557fa10fd: Status 404 returned error can't find the container with id a8987dc83332d3ca6a74e61c7572839a42a97aef21941d23a66a1ce557fa10fd Jun 08 11:58:44.973540 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.973500 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf7b66b54-q7kdb" event={"ID":"47ff4b68-72dd-4894-a06c-1a617f6ae34e","Type":"ContainerStarted","Data":"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe"} Jun 08 11:58:44.973739 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.973552 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf7b66b54-q7kdb" event={"ID":"47ff4b68-72dd-4894-a06c-1a617f6ae34e","Type":"ContainerStarted","Data":"a8987dc83332d3ca6a74e61c7572839a42a97aef21941d23a66a1ce557fa10fd"} Jun 08 11:58:44.975324 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.975295 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-7d4tr" event={"ID":"a333f3bc-7324-4931-be86-33d578070989","Type":"ContainerStarted","Data":"5e8c5e981b29127bb5706f693b9acde27636a74881a9bbacbc44f4e0a11dd69c"} Jun 08 11:58:44.975491 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.975473 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:44.977234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.977202 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd948f87-5f4rw" event={"ID":"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c","Type":"ContainerStarted","Data":"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e"} Jun 08 11:58:44.978926 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.978904 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" event={"ID":"c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4","Type":"ContainerStarted","Data":"282c997d3b14510d1d7e052cfce26fe6729e89a98340838598acd0c1d41ea3c2"} Jun 08 11:58:44.979081 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.979059 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:44.984050 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.984025 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" Jun 08 11:58:44.992376 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.992318 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-7d4tr" Jun 08 11:58:44.992615 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:44.992564 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cf7b66b54-q7kdb" podStartSLOduration=5.992547236 podStartE2EDuration="5.992547236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:44.991965442 +0000 UTC m=+281.376654058" watchObservedRunningTime="2026-06-08 11:58:44.992547236 +0000 UTC m=+281.377235827" Jun 08 11:58:45.010329 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:45.010288 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67bd948f87-5f4rw" podStartSLOduration=1.172476665 podStartE2EDuration="12.010248209s" totalImagesPullingTime="10.837771544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:45.009467048 +0000 UTC m=+281.394155640" watchObservedRunningTime="2026-06-08 11:58:45.010248209 +0000 UTC m=+281.394936799" Jun 08 11:58:45.024714 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:45.024673 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lmwgt" podStartSLOduration=2.446544555 podStartE2EDuration="12.024663924s" totalImagesPullingTime="9.578119369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:45.023231569 +0000 UTC m=+281.407920160" watchObservedRunningTime="2026-06-08 11:58:45.024663924 +0000 UTC m=+281.409352553" Jun 08 11:58:45.039178 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:45.039131 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-7d4tr" podStartSLOduration=1.22823291 podStartE2EDuration="18.039118109s" totalImagesPullingTime="16.810885199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:45.037763347 +0000 UTC m=+281.422451940" watchObservedRunningTime="2026-06-08 11:58:45.039118109 +0000 UTC m=+281.423806700" Jun 08 11:58:45.576795 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:45.576753 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" Jun 08 11:58:45.576795 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:45.576753 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nlwsj" podUID="3f7028b9-c116-490f-b863-8b6f3adb8d82" Jun 08 11:58:45.983539 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:45.983507 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:58:45.984099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:45.983531 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:58:49.043715 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.043672 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:58:49.044203 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.043814 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:58:49.046473 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.046441 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f7028b9-c116-490f-b863-8b6f3adb8d82-metrics-tls\") pod \"dns-default-nlwsj\" (UID: \"3f7028b9-c116-490f-b863-8b6f3adb8d82\") " pod="openshift-dns/dns-default-nlwsj" Jun 08 11:58:49.046590 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.046533 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"image-registry-7f8b55c876-hjjg8\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:58:49.288919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.288887 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjndr\"" Jun 08 11:58:49.288919 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.288885 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g2rfw\"" Jun 08 11:58:49.296226 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.296160 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:58:49.296367 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.296251 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:58:49.490537 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.490120 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:58:49.494799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:49.494766 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0639531b_7b10_43e5_ab00_6dfa3f724369.slice/crio-5ac631dad1448475a465bdbadc71ee15053a871d648948431d3cd1b78f1f212f WatchSource:0}: Error finding container 5ac631dad1448475a465bdbadc71ee15053a871d648948431d3cd1b78f1f212f: Status 404 returned error can't find the container with id 5ac631dad1448475a465bdbadc71ee15053a871d648948431d3cd1b78f1f212f Jun 08 11:58:49.506970 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.506943 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlwsj"] Jun 08 11:58:49.509952 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:49.509924 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7028b9_c116_490f_b863_8b6f3adb8d82.slice/crio-32075dee6399d9ef359fb72f5e442d63613ab2512168db004669a24713284e92 WatchSource:0}: Error finding container 32075dee6399d9ef359fb72f5e442d63613ab2512168db004669a24713284e92: Status 404 returned error can't find the container with id 32075dee6399d9ef359fb72f5e442d63613ab2512168db004669a24713284e92 Jun 08 11:58:49.954724 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.954656 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:49.954909 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.954735 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:58:49.956280 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.956235 2517 patch_prober.go:28] interesting pod/console-6cf7b66b54-q7kdb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 08 11:58:49.956428 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:49.956294 2517 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cf7b66b54-q7kdb" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 08 11:58:50.002976 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.002931 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlwsj" event={"ID":"3f7028b9-c116-490f-b863-8b6f3adb8d82","Type":"ContainerStarted","Data":"32075dee6399d9ef359fb72f5e442d63613ab2512168db004669a24713284e92"} Jun 08 11:58:50.006664 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.005490 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" event={"ID":"0639531b-7b10-43e5-ab00-6dfa3f724369","Type":"ContainerStarted","Data":"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a"} Jun 08 11:58:50.006664 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.005534 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" event={"ID":"0639531b-7b10-43e5-ab00-6dfa3f724369","Type":"ContainerStarted","Data":"5ac631dad1448475a465bdbadc71ee15053a871d648948431d3cd1b78f1f212f"} Jun 08 11:58:50.006664 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.006308 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:58:50.029879 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.029830 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" podStartSLOduration=286.029809863 podStartE2EDuration="4m46.029809863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:50.028005117 +0000 UTC m=+286.412693747" watchObservedRunningTime="2026-06-08 11:58:50.029809863 +0000 UTC m=+286.414498433" Jun 08 11:58:50.379818 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.379575 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn"] Jun 08 11:58:50.417211 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.417147 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn"] Jun 08 11:58:50.417488 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.417283 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.420703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.420058 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 11:58:50.420703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.420319 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 11:58:50.420703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.420552 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qd8xc\"" Jun 08 11:58:50.420926 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.420767 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 11:58:50.422627 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.421286 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-267wm"] Jun 08 11:58:50.444875 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.444846 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.447600 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.447573 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 11:58:50.447753 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.447583 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 11:58:50.447753 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.447666 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zn9wz\"" Jun 08 11:58:50.447753 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.447712 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 11:58:50.465566 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.465536 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8493105b-cebb-42fc-9a1f-6fb06f37d58b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.466040 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.465681 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.466040 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.465785 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69vn\" (UniqueName: \"kubernetes.io/projected/8493105b-cebb-42fc-9a1f-6fb06f37d58b-kube-api-access-m69vn\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.466040 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.465823 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.566651 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566605 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-wtmp\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.566838 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566683 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8493105b-cebb-42fc-9a1f-6fb06f37d58b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.566838 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566763 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-root\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.566838 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566804 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82gtj\" (UniqueName: \"kubernetes.io/projected/ee594516-9f90-46d3-a2bd-ac24f7efe81d-kube-api-access-82gtj\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566848 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566890 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-metrics-client-ca\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567132 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.566924 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.567303 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567041 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69vn\" (UniqueName: \"kubernetes.io/projected/8493105b-cebb-42fc-9a1f-6fb06f37d58b-kube-api-access-m69vn\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567334 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567582 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567593 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8493105b-cebb-42fc-9a1f-6fb06f37d58b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567614 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-sys\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567680 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.567725 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.567710 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-textfile\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.571367 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.570228 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.571367 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.570334 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8493105b-cebb-42fc-9a1f-6fb06f37d58b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.576894 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.576258 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69vn\" (UniqueName: \"kubernetes.io/projected/8493105b-cebb-42fc-9a1f-6fb06f37d58b-kube-api-access-m69vn\") pod \"openshift-state-metrics-65f78d5c66-zwwkn\" (UID: \"8493105b-cebb-42fc-9a1f-6fb06f37d58b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:50.669063 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669026 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-root\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669078 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82gtj\" (UniqueName: \"kubernetes.io/projected/ee594516-9f90-46d3-a2bd-ac24f7efe81d-kube-api-access-82gtj\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669121 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669164 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-metrics-client-ca\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669191 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-root\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669234 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669226 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669254 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-sys\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669301 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669334 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-textfile\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669407 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-wtmp\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669505 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-sys\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669771 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.669558 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-wtmp\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.669771 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:50.669614 2517 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 11:58:50.669771 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:50.669690 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls podName:ee594516-9f90-46d3-a2bd-ac24f7efe81d nodeName:}" failed. No retries permitted until 2026-06-08 11:58:51.169671256 +0000 UTC m=+287.554359828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls") pod "node-exporter-267wm" (UID: "ee594516-9f90-46d3-a2bd-ac24f7efe81d") : secret "node-exporter-tls" not found Jun 08 11:58:50.670256 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.670220 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-textfile\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.670652 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.670601 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-metrics-client-ca\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.670763 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.670694 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.674072 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.674049 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.681793 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.681767 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82gtj\" (UniqueName: \"kubernetes.io/projected/ee594516-9f90-46d3-a2bd-ac24f7efe81d-kube-api-access-82gtj\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:50.731618 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:50.731585 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" Jun 08 11:58:51.174677 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.174640 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:51.178111 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.178080 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee594516-9f90-46d3-a2bd-ac24f7efe81d-node-exporter-tls\") pod \"node-exporter-267wm\" (UID: \"ee594516-9f90-46d3-a2bd-ac24f7efe81d\") " pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:51.358050 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.357978 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-267wm" Jun 08 11:58:51.420482 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.417216 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 11:58:51.421656 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:51.421617 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee594516_9f90_46d3_a2bd_ac24f7efe81d.slice/crio-55e07636bbd6ae39be24fddd4336ab6afcf95e0fc0cf6d03c2b5b2bf66e7b4bc WatchSource:0}: Error finding container 55e07636bbd6ae39be24fddd4336ab6afcf95e0fc0cf6d03c2b5b2bf66e7b4bc: Status 404 returned error can't find the container with id 55e07636bbd6ae39be24fddd4336ab6afcf95e0fc0cf6d03c2b5b2bf66e7b4bc Jun 08 11:58:51.454533 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.454459 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 11:58:51.454687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.454591 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457149 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457154 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457388 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457472 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7f9h7\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457621 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457744 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457747 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 11:58:51.457928 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.457815 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 11:58:51.458448 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.458087 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 11:58:51.459672 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.459167 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 11:58:51.572678 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.572646 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn"] Jun 08 11:58:51.575850 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:51.575814 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8493105b_cebb_42fc_9a1f_6fb06f37d58b.slice/crio-9473cd43bfe1237bf756a3330946d5feef037c86bdf9f6dfd795b36171034e6f WatchSource:0}: Error finding container 9473cd43bfe1237bf756a3330946d5feef037c86bdf9f6dfd795b36171034e6f: Status 404 returned error can't find the container with id 9473cd43bfe1237bf756a3330946d5feef037c86bdf9f6dfd795b36171034e6f Jun 08 11:58:51.580626 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580596 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-web-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580733 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580634 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580733 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580686 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580733 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580721 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mckb\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-kube-api-access-7mckb\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580745 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580778 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580808 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580836 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.580896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580876 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.581099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580898 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.581099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580927 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-config-volume\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.581099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.580962 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-config-out\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.581099 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.581026 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682134 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682047 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682134 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682117 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682369 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682149 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682369 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682181 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-config-volume\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682369 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682210 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-config-out\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.682369 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:51.682252 2517 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle podName:88441795-fd58-4821-8786-8dd7822ca896 nodeName:}" failed. No retries permitted until 2026-06-08 11:58:52.182224124 +0000 UTC m=+288.566912696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "88441795-fd58-4821-8786-8dd7822ca896") : configmap references non-existent config key: ca-bundle.crt Jun 08 11:58:51.682798 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682769 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682912 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682962 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-web-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.682987 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.683060 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.683103 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mckb\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-kube-api-access-7mckb\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.683129 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.683163 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.683536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.683193 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.685468 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.685045 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.685468 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.685238 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88441795-fd58-4821-8786-8dd7822ca896-config-out\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.685468 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.685393 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.685870 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.685701 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-config-volume\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.686367 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.686311 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-web-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.687469 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.687442 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.688100 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.688043 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.688100 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.688051 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.689016 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.688992 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88441795-fd58-4821-8786-8dd7822ca896-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.689388 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.689371 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:51.693723 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:51.693701 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mckb\" (UniqueName: \"kubernetes.io/projected/88441795-fd58-4821-8786-8dd7822ca896-kube-api-access-7mckb\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:52.020752 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.020686 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlwsj" event={"ID":"3f7028b9-c116-490f-b863-8b6f3adb8d82","Type":"ContainerStarted","Data":"a78811dbf825ad572da6553daf1423c8948ccb51a424088f27f30b499147b57d"} Jun 08 11:58:52.022325 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.022249 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-267wm" event={"ID":"ee594516-9f90-46d3-a2bd-ac24f7efe81d","Type":"ContainerStarted","Data":"55e07636bbd6ae39be24fddd4336ab6afcf95e0fc0cf6d03c2b5b2bf66e7b4bc"} Jun 08 11:58:52.025406 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.025021 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" event={"ID":"8493105b-cebb-42fc-9a1f-6fb06f37d58b","Type":"ContainerStarted","Data":"cb6399a6012c1b90b59718c280c248434a16b1363212e09322a6e5b677c8e155"} Jun 08 11:58:52.025406 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.025090 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" event={"ID":"8493105b-cebb-42fc-9a1f-6fb06f37d58b","Type":"ContainerStarted","Data":"cf91f83b9925db51d7bb192594bb101a87debb8e8152d44b130bc4203716861c"} Jun 08 11:58:52.025406 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.025122 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" event={"ID":"8493105b-cebb-42fc-9a1f-6fb06f37d58b","Type":"ContainerStarted","Data":"9473cd43bfe1237bf756a3330946d5feef037c86bdf9f6dfd795b36171034e6f"} Jun 08 11:58:52.189148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.188321 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:52.189741 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.189679 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88441795-fd58-4821-8786-8dd7822ca896-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88441795-fd58-4821-8786-8dd7822ca896\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:52.356868 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.356620 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc"] Jun 08 11:58:52.368921 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.368871 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 11:58:52.382104 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.382043 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc"] Jun 08 11:58:52.382256 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.382204 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.386003 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.385605 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 11:58:52.386003 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.385808 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eklri996e8e2i\"" Jun 08 11:58:52.386003 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.385883 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 11:58:52.386438 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.386420 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 11:58:52.386653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.386634 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 11:58:52.386731 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.386719 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 11:58:52.387029 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.386834 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kdcgb\"" Jun 08 11:58:52.494712 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494632 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-grpc-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494729 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494772 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494833 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494912 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.494955 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.495037 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202d416a-0baa-41d4-a206-0993765117a8-metrics-client-ca\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.495148 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.495062 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2p4\" (UniqueName: \"kubernetes.io/projected/202d416a-0baa-41d4-a206-0993765117a8-kube-api-access-8s2p4\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.595753 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595715 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.595879 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595772 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.595879 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595806 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.595879 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595832 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.596058 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595908 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202d416a-0baa-41d4-a206-0993765117a8-metrics-client-ca\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.596058 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.595933 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2p4\" (UniqueName: \"kubernetes.io/projected/202d416a-0baa-41d4-a206-0993765117a8-kube-api-access-8s2p4\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.596058 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.596011 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-grpc-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.596058 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.596053 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.596912 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.596883 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/202d416a-0baa-41d4-a206-0993765117a8-metrics-client-ca\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.598903 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.598875 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.599908 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.599875 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.600776 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.600728 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.601305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.601278 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.603190 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.603138 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-thanos-querier-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.603478 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.603454 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/202d416a-0baa-41d4-a206-0993765117a8-secret-grpc-tls\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.607095 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.607040 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2p4\" (UniqueName: \"kubernetes.io/projected/202d416a-0baa-41d4-a206-0993765117a8-kube-api-access-8s2p4\") pod \"thanos-querier-59d85dd4b8-t2jtc\" (UID: \"202d416a-0baa-41d4-a206-0993765117a8\") " pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.707227 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.707193 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:52.751749 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.751699 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 11:58:52.756799 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:52.756767 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88441795_fd58_4821_8786_8dd7822ca896.slice/crio-157063c1a7e272cd437f413d0c386f45c7e9caa31ea2757857dd2f860f10086d WatchSource:0}: Error finding container 157063c1a7e272cd437f413d0c386f45c7e9caa31ea2757857dd2f860f10086d: Status 404 returned error can't find the container with id 157063c1a7e272cd437f413d0c386f45c7e9caa31ea2757857dd2f860f10086d Jun 08 11:58:52.876093 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:52.876015 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc"] Jun 08 11:58:52.936945 ip-10-0-140-135 kubenswrapper[2517]: W0608 11:58:52.936904 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202d416a_0baa_41d4_a206_0993765117a8.slice/crio-f7fc12d3260452386efadb2de0e3407432387350a16e2d59ed1138adf119db4a WatchSource:0}: Error finding container f7fc12d3260452386efadb2de0e3407432387350a16e2d59ed1138adf119db4a: Status 404 returned error can't find the container with id f7fc12d3260452386efadb2de0e3407432387350a16e2d59ed1138adf119db4a Jun 08 11:58:53.032692 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.032598 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"f7fc12d3260452386efadb2de0e3407432387350a16e2d59ed1138adf119db4a"} Jun 08 11:58:53.036891 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.036052 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlwsj" event={"ID":"3f7028b9-c116-490f-b863-8b6f3adb8d82","Type":"ContainerStarted","Data":"57210fa8f2bddb4a2c866fd4ef92e319270bb31a36b55ad6585c0482c4f6242a"} Jun 08 11:58:53.036891 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.036830 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:58:53.038510 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.038487 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"157063c1a7e272cd437f413d0c386f45c7e9caa31ea2757857dd2f860f10086d"} Jun 08 11:58:53.058948 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.058564 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nlwsj" podStartSLOduration=251.791497969 podStartE2EDuration="4m14.058546836s" totalImagesPullingTime="2.267048867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:53.057445216 +0000 UTC m=+289.442133819" watchObservedRunningTime="2026-06-08 11:58:53.058546836 +0000 UTC m=+289.443235428" Jun 08 11:58:53.556430 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.556139 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:53.556430 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.556199 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:58:53.557760 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.557602 2517 patch_prober.go:28] interesting pod/console-67bd948f87-5f4rw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 08 11:58:53.557760 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:53.557653 2517 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67bd948f87-5f4rw" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 08 11:58:54.045812 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:54.045777 2517 generic.go:356] "Generic (PLEG): container finished" podID="ee594516-9f90-46d3-a2bd-ac24f7efe81d" containerID="f395fe15336aee4f77f547c3e1180893959d0164305406aba8df3b8ffbd93b66" exitCode=0 Jun 08 11:58:54.046102 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:54.045864 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-267wm" event={"ID":"ee594516-9f90-46d3-a2bd-ac24f7efe81d","Type":"ContainerDied","Data":"f395fe15336aee4f77f547c3e1180893959d0164305406aba8df3b8ffbd93b66"} Jun 08 11:58:55.053195 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.053110 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-267wm" event={"ID":"ee594516-9f90-46d3-a2bd-ac24f7efe81d","Type":"ContainerStarted","Data":"549cb84750a3a48e8ee8406fe9339ff79de2c109b6ebc556339f84561eb1575c"} Jun 08 11:58:55.053668 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.053215 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-267wm" event={"ID":"ee594516-9f90-46d3-a2bd-ac24f7efe81d","Type":"ContainerStarted","Data":"ced4f9c349658699fc4834df36d45e0a058c1ac28446f5c60f5967f627ccbbd8"} Jun 08 11:58:55.055607 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.055572 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" event={"ID":"8493105b-cebb-42fc-9a1f-6fb06f37d58b","Type":"ContainerStarted","Data":"f7d860fbfd21a8d61bf673b3f68cfd435e11b2038133e29d3acb542bc9730d34"} Jun 08 11:58:55.057586 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.057541 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"7ba473e4a0d0c057f9119b8b80061e37c830701304cbb538a42c6efaa345dc19"} Jun 08 11:58:55.074268 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.074227 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-267wm" podStartSLOduration=3.437841097 podStartE2EDuration="5.074211052s" totalImagesPullingTime="1.535983337s" totalInitContainerRuntime="100.386618ms" isStatefulPod=true podCreationTimestamp="2026-06-08 11:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:55.072010124 +0000 UTC m=+291.456698718" watchObservedRunningTime="2026-06-08 11:58:55.074211052 +0000 UTC m=+291.458899644" Jun 08 11:58:55.124175 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.124121 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwwkn" podStartSLOduration=2.790128573 podStartE2EDuration="5.12410108s" totalImagesPullingTime="2.333972507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:55.122278951 +0000 UTC m=+291.506967546" watchObservedRunningTime="2026-06-08 11:58:55.12410108 +0000 UTC m=+291.508789672" Jun 08 11:58:55.170542 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:55.170509 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:58:56.067290 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:56.067259 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"81915aae3277a5b9b3e95f0449a495253890eb3374a121f02e0b371905a4ccac"} Jun 08 11:58:56.067714 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:56.067364 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"00da4f2b1333908a8f6b681641ee1342f14cebcdb7d81308d7a68bdc819f3d59"} Jun 08 11:58:56.068868 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:56.068845 2517 generic.go:356] "Generic (PLEG): container finished" podID="88441795-fd58-4821-8786-8dd7822ca896" containerID="7ba473e4a0d0c057f9119b8b80061e37c830701304cbb538a42c6efaa345dc19" exitCode=0 Jun 08 11:58:56.068969 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:56.068924 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerDied","Data":"7ba473e4a0d0c057f9119b8b80061e37c830701304cbb538a42c6efaa345dc19"} Jun 08 11:58:57.076582 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:57.076549 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"636ba846b830a4890deed9de28e1af97d608d91bb2d57f62ce86beade8058d74"} Jun 08 11:58:57.098042 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:58:57.098005 2517 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vhzrt" podUID="7031fce5-b92d-4dc3-a5cf-ac1dbf238b90" Jun 08 11:58:58.082880 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:58.082850 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"7d99c5cf6440a9d339117a9ebe2fa0bf4445b948a4ed68aa3161dc9cebe80d63"} Jun 08 11:58:58.083273 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:58.082961 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"417ff6a31ce3d3ca9687869e959791b0f59fe0bbdcbf8d554b87c62cc023a017"} Jun 08 11:58:59.090284 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.090186 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" event={"ID":"202d416a-0baa-41d4-a206-0993765117a8","Type":"ContainerStarted","Data":"9a699eacbff91f4d9c4e874529fc506c7855cbd752e780ece7d18ef882eec767"} Jun 08 11:58:59.090769 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.090283 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:58:59.093079 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093056 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"3a69f7af3e399ec937c0a395616d8ac3c9acef993a693480d7c0ae1eaf834d6a"} Jun 08 11:58:59.093176 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093107 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"689ca7e1e639397e65b8d87c9e5a76a9408bb17324f939efa654d6d190f2fd92"} Jun 08 11:58:59.093176 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093134 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"4a447e32861956fb8847da1da8a1c7db24b991a5f9a64984e7f87e2d30c3119b"} Jun 08 11:58:59.093176 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093160 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"370a5769aa5e3d5e0503890d9bc43022d17a10abedeebf4bb98358b0394bda1d"} Jun 08 11:58:59.093272 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093187 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"ae32828182bdefc5738da03cbd4fef49aae901de67b159f8780c840c02c5d548"} Jun 08 11:58:59.093272 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.093210 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88441795-fd58-4821-8786-8dd7822ca896","Type":"ContainerStarted","Data":"38cce0aaf3974c4919c550be29394b79f9065266671374a5feef77bf6c399150"} Jun 08 11:58:59.112703 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.112661 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" podStartSLOduration=2.585209375 podStartE2EDuration="7.112645721s" totalImagesPullingTime="4.527436346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:59.111891111 +0000 UTC m=+295.496579702" watchObservedRunningTime="2026-06-08 11:58:59.112645721 +0000 UTC m=+295.497334696" Jun 08 11:58:59.135879 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.135838 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.029245408 podStartE2EDuration="8.135823646s" totalImagesPullingTime="4.083367056s" totalInitContainerRuntime="23.211182ms" isStatefulPod=false podCreationTimestamp="2026-06-08 11:58:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:58:59.134526765 +0000 UTC m=+295.519215367" watchObservedRunningTime="2026-06-08 11:58:59.135823646 +0000 UTC m=+295.520512236" Jun 08 11:58:59.954404 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.954366 2517 patch_prober.go:28] interesting pod/console-6cf7b66b54-q7kdb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 08 11:58:59.954662 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:58:59.954419 2517 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cf7b66b54-q7kdb" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 08 11:59:00.104094 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:00.104067 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59d85dd4b8-t2jtc" Jun 08 11:59:00.219219 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:00.219141 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:59:01.060179 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:01.060148 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nlwsj" Jun 08 11:59:04.054005 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:04.053975 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:59:04.054445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:04.054014 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 11:59:04.060896 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:04.060875 2517 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 11:59:08.096369 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:08.096317 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 11:59:09.300885 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:09.300847 2517 patch_prober.go:28] interesting pod/image-registry-7f8b55c876-hjjg8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 11:59:09.301303 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:09.300901 2517 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 11:59:12.029952 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:12.029921 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:59:17.811171 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:17.811140 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:59:20.198539 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.198499 2517 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67bd948f87-5f4rw" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerName="console" containerID="cri-o://a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e" gracePeriod=15 Jun 08 11:59:20.468609 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.468543 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:59:20.553945 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.553902 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.553945 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.553941 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.554194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.553985 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.554194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554046 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcd9k\" (UniqueName: \"kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.554194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554077 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.554194 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554124 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert\") pod \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\" (UID: \"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c\") " Jun 08 11:59:20.554490 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554464 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:20.554648 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554598 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config" (OuterVolumeSpecName: "console-config") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:20.554721 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.554696 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:20.556405 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.556384 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k" (OuterVolumeSpecName: "kube-api-access-fcd9k") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "kube-api-access-fcd9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 11:59:20.556692 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.556670 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:20.556756 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.556699 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" (UID: "5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:20.655503 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655473 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-oauth-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:20.655503 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655498 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-oauth-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:20.655687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655510 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:20.655687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655522 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-service-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:20.655687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655534 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcd9k\" (UniqueName: \"kubernetes.io/projected/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-kube-api-access-fcd9k\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:20.655687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:20.655547 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c-console-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:21.178599 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.178560 2517 generic.go:356] "Generic (PLEG): container finished" podID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerID="a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e" exitCode=0 Jun 08 11:59:21.178749 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.178606 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd948f87-5f4rw" Jun 08 11:59:21.178749 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.178650 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd948f87-5f4rw" event={"ID":"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c","Type":"ContainerDied","Data":"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e"} Jun 08 11:59:21.178749 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.178703 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd948f87-5f4rw" event={"ID":"5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c","Type":"ContainerDied","Data":"9169a73149ac4fb82fcf8a2f125c3072f3f0b9c459fa4fdd3f5367c524351353"} Jun 08 11:59:21.178749 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.178726 2517 scope.go:117] "RemoveContainer" containerID="a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e" Jun 08 11:59:21.196381 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.196357 2517 scope.go:117] "RemoveContainer" containerID="a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e" Jun 08 11:59:21.196659 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:59:21.196638 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e\": container with ID starting with a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e not found: ID does not exist" containerID="a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e" Jun 08 11:59:21.196737 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.196671 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e"} err="failed to get container status \"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e\": rpc error: code = NotFound desc = could not find container \"a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e\": container with ID starting with a9754b79d0d71510c85b53290022fe0ce809eb798343cb912682e3ae4420a27e not found: ID does not exist" Jun 08 11:59:21.204289 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.204267 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:59:21.208457 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:21.208438 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bd948f87-5f4rw"] Jun 08 11:59:22.102352 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:22.102316 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" path="/var/lib/kubelet/pods/5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c/volumes" Jun 08 11:59:24.192650 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:24.192618 2517 generic.go:356] "Generic (PLEG): container finished" podID="7891aeda-35a2-406b-870d-a527867dcd77" containerID="13961efa2608e3f6f7a7de9bf2dcbf0c71222c87fa509cc3e18d92f349bc89d0" exitCode=0 Jun 08 11:59:24.193033 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:24.192691 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" event={"ID":"7891aeda-35a2-406b-870d-a527867dcd77","Type":"ContainerDied","Data":"13961efa2608e3f6f7a7de9bf2dcbf0c71222c87fa509cc3e18d92f349bc89d0"} Jun 08 11:59:24.193091 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:24.193040 2517 scope.go:117] "RemoveContainer" containerID="13961efa2608e3f6f7a7de9bf2dcbf0c71222c87fa509cc3e18d92f349bc89d0" Jun 08 11:59:25.198136 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.198100 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wfmqr" event={"ID":"7891aeda-35a2-406b-870d-a527867dcd77","Type":"ContainerStarted","Data":"95b89f6af1244b4727c1b1b0327dcbbc98f25d41d3fe9ff65037901cb22fb9cd"} Jun 08 11:59:25.238363 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.238277 2517 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cf7b66b54-q7kdb" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" containerID="cri-o://28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe" gracePeriod=15 Jun 08 11:59:25.507386 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.507360 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:59:25.596182 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596150 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596182 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596183 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596222 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596249 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596287 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqdlt\" (UniqueName: \"kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596323 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596380 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert\") pod \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\" (UID: \"47ff4b68-72dd-4894-a06c-1a617f6ae34e\") " Jun 08 11:59:25.596653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596546 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca" (OuterVolumeSpecName: "service-ca") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:25.596653 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596640 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:25.596761 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596723 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-service-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.596761 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596739 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-trusted-ca-bundle\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.596866 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596759 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config" (OuterVolumeSpecName: "console-config") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:25.596954 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.596932 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:25.598515 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.598490 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:25.598615 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.598513 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:25.598615 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.598571 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt" (OuterVolumeSpecName: "kube-api-access-dqdlt") pod "47ff4b68-72dd-4894-a06c-1a617f6ae34e" (UID: "47ff4b68-72dd-4894-a06c-1a617f6ae34e"). InnerVolumeSpecName "kube-api-access-dqdlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 11:59:25.697524 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.697496 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-oauth-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.697524 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.697521 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.697678 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.697530 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqdlt\" (UniqueName: \"kubernetes.io/projected/47ff4b68-72dd-4894-a06c-1a617f6ae34e-kube-api-access-dqdlt\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.697678 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.697539 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ff4b68-72dd-4894-a06c-1a617f6ae34e-console-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:25.697678 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:25.697548 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ff4b68-72dd-4894-a06c-1a617f6ae34e-oauth-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:26.203908 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.203877 2517 generic.go:356] "Generic (PLEG): container finished" podID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerID="28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe" exitCode=0 Jun 08 11:59:26.204397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.203933 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf7b66b54-q7kdb" Jun 08 11:59:26.204397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.203960 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf7b66b54-q7kdb" event={"ID":"47ff4b68-72dd-4894-a06c-1a617f6ae34e","Type":"ContainerDied","Data":"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe"} Jun 08 11:59:26.204397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.204022 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf7b66b54-q7kdb" event={"ID":"47ff4b68-72dd-4894-a06c-1a617f6ae34e","Type":"ContainerDied","Data":"a8987dc83332d3ca6a74e61c7572839a42a97aef21941d23a66a1ce557fa10fd"} Jun 08 11:59:26.204397 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.204053 2517 scope.go:117] "RemoveContainer" containerID="28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe" Jun 08 11:59:26.212260 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.212244 2517 scope.go:117] "RemoveContainer" containerID="28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe" Jun 08 11:59:26.212514 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:59:26.212495 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe\": container with ID starting with 28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe not found: ID does not exist" containerID="28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe" Jun 08 11:59:26.212569 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.212522 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe"} err="failed to get container status \"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe\": rpc error: code = NotFound desc = could not find container \"28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe\": container with ID starting with 28d6e413183a2dd9cca3bd9eeefd5559540b31c66191728fdbc0af72143e46fe not found: ID does not exist" Jun 08 11:59:26.227844 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.227823 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:59:26.237387 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:26.237368 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf7b66b54-q7kdb"] Jun 08 11:59:28.100991 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:28.100958 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" path="/var/lib/kubelet/pods/47ff4b68-72dd-4894-a06c-1a617f6ae34e/volumes" Jun 08 11:59:29.217299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:29.217268 2517 generic.go:356] "Generic (PLEG): container finished" podID="56574e26-6d98-45a9-83fb-a8c475847226" containerID="7239a92615cd7dd6f9b8d05e4b761ecb376d0881313d455cf5cb8ed019bc0a62" exitCode=0 Jun 08 11:59:29.217684 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:29.217373 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" event={"ID":"56574e26-6d98-45a9-83fb-a8c475847226","Type":"ContainerDied","Data":"7239a92615cd7dd6f9b8d05e4b761ecb376d0881313d455cf5cb8ed019bc0a62"} Jun 08 11:59:29.217726 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:29.217691 2517 scope.go:117] "RemoveContainer" containerID="7239a92615cd7dd6f9b8d05e4b761ecb376d0881313d455cf5cb8ed019bc0a62" Jun 08 11:59:30.222930 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:30.222898 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4w9np" event={"ID":"56574e26-6d98-45a9-83fb-a8c475847226","Type":"ContainerStarted","Data":"b556de4f21daf08d8d409a83acd1c21b6dcfe338877ee9d7ed247575336790f2"} Jun 08 11:59:34.239690 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:34.239656 2517 generic.go:356] "Generic (PLEG): container finished" podID="e23505ba-9475-46d9-af7b-22b07c542d22" containerID="dfc8c95e9e9f42f08e4dfccf490417f93ce02415163f61e2e17ff25519353a39" exitCode=0 Jun 08 11:59:34.240119 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:34.239690 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-n7mhp" event={"ID":"e23505ba-9475-46d9-af7b-22b07c542d22","Type":"ContainerDied","Data":"dfc8c95e9e9f42f08e4dfccf490417f93ce02415163f61e2e17ff25519353a39"} Jun 08 11:59:34.240119 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:34.240041 2517 scope.go:117] "RemoveContainer" containerID="dfc8c95e9e9f42f08e4dfccf490417f93ce02415163f61e2e17ff25519353a39" Jun 08 11:59:35.197693 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:35.197663 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqmh_6f21d298-2c6b-405e-bae4-30796db38eec/serve-healthcheck-canary/0.log" Jun 08 11:59:35.248629 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:35.248593 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-n7mhp" event={"ID":"e23505ba-9475-46d9-af7b-22b07c542d22","Type":"ContainerStarted","Data":"9fe5150d970005e276ed76c2ce7f6233d7627320e239309104e8bfb568066221"} Jun 08 11:59:42.830547 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:42.830500 2517 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerName="registry" containerID="cri-o://d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a" gracePeriod=30 Jun 08 11:59:43.069410 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.069387 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:59:43.148530 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148506 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148700 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148540 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148700 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148572 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148700 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148604 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57h8t\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148700 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148659 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148918 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148782 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148918 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148824 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.148918 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.148864 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets\") pod \"0639531b-7b10-43e5-ab00-6dfa3f724369\" (UID: \"0639531b-7b10-43e5-ab00-6dfa3f724369\") " Jun 08 11:59:43.149326 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.149049 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:43.149326 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.149159 2517 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-certificates\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.149536 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.149503 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 11:59:43.151687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.151652 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:43.151687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.151670 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t" (OuterVolumeSpecName: "kube-api-access-57h8t") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "kube-api-access-57h8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 11:59:43.151687 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.151655 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 11:59:43.151873 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.151714 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 11:59:43.151963 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.151932 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 11:59:43.172989 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.172966 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0639531b-7b10-43e5-ab00-6dfa3f724369" (UID: "0639531b-7b10-43e5-ab00-6dfa3f724369"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 11:59:43.250116 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250075 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0639531b-7b10-43e5-ab00-6dfa3f724369-trusted-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250116 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250113 2517 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-installation-pull-secrets\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250116 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250125 2517 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0639531b-7b10-43e5-ab00-6dfa3f724369-image-registry-private-configuration\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250136 2517 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0639531b-7b10-43e5-ab00-6dfa3f724369-ca-trust-extracted\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250145 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57h8t\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-kube-api-access-57h8t\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250155 2517 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-bound-sa-token\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.250305 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.250163 2517 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0639531b-7b10-43e5-ab00-6dfa3f724369-registry-tls\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 11:59:43.283299 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.283271 2517 generic.go:356] "Generic (PLEG): container finished" podID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerID="d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a" exitCode=0 Jun 08 11:59:43.283445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.283312 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" Jun 08 11:59:43.283445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.283378 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" event={"ID":"0639531b-7b10-43e5-ab00-6dfa3f724369","Type":"ContainerDied","Data":"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a"} Jun 08 11:59:43.283445 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.283437 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8b55c876-hjjg8" event={"ID":"0639531b-7b10-43e5-ab00-6dfa3f724369","Type":"ContainerDied","Data":"5ac631dad1448475a465bdbadc71ee15053a871d648948431d3cd1b78f1f212f"} Jun 08 11:59:43.283607 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.283465 2517 scope.go:117] "RemoveContainer" containerID="d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a" Jun 08 11:59:43.292694 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.292675 2517 scope.go:117] "RemoveContainer" containerID="d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a" Jun 08 11:59:43.292927 ip-10-0-140-135 kubenswrapper[2517]: E0608 11:59:43.292903 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a\": container with ID starting with d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a not found: ID does not exist" containerID="d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a" Jun 08 11:59:43.293015 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.292931 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a"} err="failed to get container status \"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a\": rpc error: code = NotFound desc = could not find container \"d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a\": container with ID starting with d0af45c2eeaef6be5797c7aeff35f715644c6879ae0f6a5bcb4e1e7e529f494a not found: ID does not exist" Jun 08 11:59:43.310430 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.310403 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:59:43.313774 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:43.313754 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f8b55c876-hjjg8"] Jun 08 11:59:44.101525 ip-10-0-140-135 kubenswrapper[2517]: I0608 11:59:44.101494 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" path="/var/lib/kubelet/pods/0639531b-7b10-43e5-ab00-6dfa3f724369/volumes" Jun 08 12:00:18.029615 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.029575 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 12:00:18.031888 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.031868 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7031fce5-b92d-4dc3-a5cf-ac1dbf238b90-metrics-certs\") pod \"network-metrics-daemon-vhzrt\" (UID: \"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90\") " pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 12:00:18.301139 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.301060 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xk9wx\"" Jun 08 12:00:18.308397 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.308380 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vhzrt" Jun 08 12:00:18.445760 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.445736 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vhzrt"] Jun 08 12:00:18.448415 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:00:18.448388 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7031fce5_b92d_4dc3_a5cf_ac1dbf238b90.slice/crio-b82228f408bdf40e3c7fe8677128e68442b8973fb291ffd5667f89dcc0cd8510 WatchSource:0}: Error finding container b82228f408bdf40e3c7fe8677128e68442b8973fb291ffd5667f89dcc0cd8510: Status 404 returned error can't find the container with id b82228f408bdf40e3c7fe8677128e68442b8973fb291ffd5667f89dcc0cd8510 Jun 08 12:00:18.450628 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:18.450611 2517 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:00:19.435933 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:19.435881 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vhzrt" event={"ID":"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90","Type":"ContainerStarted","Data":"b82228f408bdf40e3c7fe8677128e68442b8973fb291ffd5667f89dcc0cd8510"} Jun 08 12:00:20.441267 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:20.441227 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vhzrt" event={"ID":"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90","Type":"ContainerStarted","Data":"e47078dd4d00a1b347e9cd81354f0f822c246bfd23e26562ea3ecb017f8bf974"} Jun 08 12:00:20.441666 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:20.441278 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vhzrt" event={"ID":"7031fce5-b92d-4dc3-a5cf-ac1dbf238b90","Type":"ContainerStarted","Data":"4f2c1407a5b887283d812a501bc6e8b8c2a883b12e2925d5b7c7b2acc2abf93d"} Jun 08 12:00:20.464408 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:20.464352 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vhzrt" podStartSLOduration=375.417246664 podStartE2EDuration="6m16.464321469s" totalImagesPullingTime="1.047074805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:00:20.462217027 +0000 UTC m=+376.846905618" watchObservedRunningTime="2026-06-08 12:00:20.464321469 +0000 UTC m=+376.849010060" Jun 08 12:00:21.651333 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651306 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:00:21.651680 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651640 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerName="console" Jun 08 12:00:21.651680 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651652 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerName="console" Jun 08 12:00:21.651680 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651666 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" Jun 08 12:00:21.651680 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651674 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" Jun 08 12:00:21.651804 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651683 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerName="registry" Jun 08 12:00:21.651804 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651691 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerName="registry" Jun 08 12:00:21.651804 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651742 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8c3d33-9fd6-4d8c-9356-9133ec18aa1c" containerName="console" Jun 08 12:00:21.651804 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651753 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="0639531b-7b10-43e5-ab00-6dfa3f724369" containerName="registry" Jun 08 12:00:21.651804 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.651762 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="47ff4b68-72dd-4894-a06c-1a617f6ae34e" containerName="console" Jun 08 12:00:21.654758 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.654740 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.659136 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.659112 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 12:00:21.659762 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.659747 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 12:00:21.660647 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.660625 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 12:00:21.660750 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.660697 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4z5l5\"" Jun 08 12:00:21.660812 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.660771 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 12:00:21.660861 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.660826 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 12:00:21.690221 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.690141 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 12:00:21.691905 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.691881 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:00:21.763594 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763561 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztwx\" (UniqueName: \"kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763745 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763601 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763745 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763628 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763745 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763708 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763848 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763748 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763848 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763769 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.763848 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.763816 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864629 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864590 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864785 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864647 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864785 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864684 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864862 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864841 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864911 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864894 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.864965 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864945 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztwx\" (UniqueName: \"kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.865018 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.864977 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.865448 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.865423 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.865572 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.865515 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.865572 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.865561 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.865795 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.865778 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.867132 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.867106 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.867288 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.867264 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.873513 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.873480 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztwx\" (UniqueName: \"kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx\") pod \"console-7b65f58d44-4n6nd\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:21.965266 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:21.965182 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:22.094118 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:22.094095 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:00:22.096069 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:00:22.096037 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63237d44_3c12_43d9_8dcb_df81d41a556b.slice/crio-8528d3698fcf7ea8c581e0a495ac4d24167684ea0850ce46443d3d61137bafc5 WatchSource:0}: Error finding container 8528d3698fcf7ea8c581e0a495ac4d24167684ea0850ce46443d3d61137bafc5: Status 404 returned error can't find the container with id 8528d3698fcf7ea8c581e0a495ac4d24167684ea0850ce46443d3d61137bafc5 Jun 08 12:00:22.450490 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:22.450458 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65f58d44-4n6nd" event={"ID":"63237d44-3c12-43d9-8dcb-df81d41a556b","Type":"ContainerStarted","Data":"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1"} Jun 08 12:00:22.450658 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:22.450506 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65f58d44-4n6nd" event={"ID":"63237d44-3c12-43d9-8dcb-df81d41a556b","Type":"ContainerStarted","Data":"8528d3698fcf7ea8c581e0a495ac4d24167684ea0850ce46443d3d61137bafc5"} Jun 08 12:00:22.476873 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:22.476816 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b65f58d44-4n6nd" podStartSLOduration=1.476801141 podStartE2EDuration="1.476801141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:00:22.476123264 +0000 UTC m=+378.860811853" watchObservedRunningTime="2026-06-08 12:00:22.476801141 +0000 UTC m=+378.861489788" Jun 08 12:00:31.965709 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:31.965672 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:31.966110 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:31.965775 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:31.970169 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:31.970140 2517 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:00:32.492795 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:00:32.492762 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:01:55.554753 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.554662 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f"] Jun 08 12:01:55.558086 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.558069 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.561076 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.561060 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:01:55.562256 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.562235 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2d9kh\"" Jun 08 12:01:55.562379 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.562254 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:01:55.570203 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.570181 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f"] Jun 08 12:01:55.639785 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.639752 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.639941 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.639789 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfs8x\" (UniqueName: \"kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.639941 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.639840 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.741036 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.740990 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.741036 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.741036 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfs8x\" (UniqueName: \"kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.741231 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.741073 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.741377 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.741358 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.741457 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.741438 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.750826 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.750804 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfs8x\" (UniqueName: \"kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.866979 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.866899 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:01:55.995891 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:55.995845 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f"] Jun 08 12:01:55.998526 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:01:55.998495 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d525c35_0d26_40e6_9af7_3559e2d8c6e7.slice/crio-e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a WatchSource:0}: Error finding container e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a: Status 404 returned error can't find the container with id e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a Jun 08 12:01:56.827318 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:01:56.827284 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" event={"ID":"2d525c35-0d26-40e6-9af7-3559e2d8c6e7","Type":"ContainerStarted","Data":"e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a"} Jun 08 12:02:04.864608 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:04.864572 2517 generic.go:356] "Generic (PLEG): container finished" podID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerID="0e81df79dbb495e4ea956d8cb4000c5aeea90b7561d06a93c23a1bd756401f3f" exitCode=0 Jun 08 12:02:04.864988 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:04.864663 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" event={"ID":"2d525c35-0d26-40e6-9af7-3559e2d8c6e7","Type":"ContainerDied","Data":"0e81df79dbb495e4ea956d8cb4000c5aeea90b7561d06a93c23a1bd756401f3f"} Jun 08 12:02:05.870469 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:05.870387 2517 generic.go:356] "Generic (PLEG): container finished" podID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerID="6fc3039992ecb40827e6524281450b82fbeae80adaba146ff83c7f098c0348d1" exitCode=0 Jun 08 12:02:05.870854 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:05.870465 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" event={"ID":"2d525c35-0d26-40e6-9af7-3559e2d8c6e7","Type":"ContainerDied","Data":"6fc3039992ecb40827e6524281450b82fbeae80adaba146ff83c7f098c0348d1"} Jun 08 12:02:13.907128 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:13.907096 2517 generic.go:356] "Generic (PLEG): container finished" podID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerID="f124e8de849f2b059dd836ba275801dd299974018906693866a5c055d3c4c455" exitCode=0 Jun 08 12:02:13.907518 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:13.907149 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" event={"ID":"2d525c35-0d26-40e6-9af7-3559e2d8c6e7","Type":"ContainerDied","Data":"f124e8de849f2b059dd836ba275801dd299974018906693866a5c055d3c4c455"} Jun 08 12:02:15.034041 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.034017 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:02:15.106719 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.106692 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfs8x\" (UniqueName: \"kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x\") pod \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " Jun 08 12:02:15.106866 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.106738 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util\") pod \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " Jun 08 12:02:15.106866 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.106761 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle\") pod \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\" (UID: \"2d525c35-0d26-40e6-9af7-3559e2d8c6e7\") " Jun 08 12:02:15.107419 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.107391 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle" (OuterVolumeSpecName: "bundle") pod "2d525c35-0d26-40e6-9af7-3559e2d8c6e7" (UID: "2d525c35-0d26-40e6-9af7-3559e2d8c6e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:02:15.108827 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.108805 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x" (OuterVolumeSpecName: "kube-api-access-tfs8x") pod "2d525c35-0d26-40e6-9af7-3559e2d8c6e7" (UID: "2d525c35-0d26-40e6-9af7-3559e2d8c6e7"). InnerVolumeSpecName "kube-api-access-tfs8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:02:15.110722 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.110693 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util" (OuterVolumeSpecName: "util") pod "2d525c35-0d26-40e6-9af7-3559e2d8c6e7" (UID: "2d525c35-0d26-40e6-9af7-3559e2d8c6e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:02:15.207422 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.207319 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfs8x\" (UniqueName: \"kubernetes.io/projected/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-kube-api-access-tfs8x\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:15.207422 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.207378 2517 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-util\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:15.207422 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.207392 2517 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d525c35-0d26-40e6-9af7-3559e2d8c6e7-bundle\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:15.923628 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.923593 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" event={"ID":"2d525c35-0d26-40e6-9af7-3559e2d8c6e7","Type":"ContainerDied","Data":"e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a"} Jun 08 12:02:15.923951 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.923932 2517 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0db0308e6578ad240c37a0a1452091082ba759e6828df2f64afd1e78c49155a" Jun 08 12:02:15.924107 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:15.923987 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpvb6f" Jun 08 12:02:31.461426 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461388 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j"] Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461849 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="pull" Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461868 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="pull" Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461914 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="extract" Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461925 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="extract" Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461939 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="util" Jun 08 12:02:31.462000 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.461950 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="util" Jun 08 12:02:31.462293 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.462022 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d525c35-0d26-40e6-9af7-3559e2d8c6e7" containerName="extract" Jun 08 12:02:31.463721 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.463702 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.466784 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.466753 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nf62w\"" Jun 08 12:02:31.466904 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.466885 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 12:02:31.467693 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.467678 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 12:02:31.477768 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.477740 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j"] Jun 08 12:02:31.547792 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.547760 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.547933 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.547814 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndd8j\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-kube-api-access-ndd8j\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.648812 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.648782 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.648922 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.648826 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndd8j\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-kube-api-access-ndd8j\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.667160 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.667138 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.690882 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.690859 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndd8j\" (UniqueName: \"kubernetes.io/projected/9174274f-a7b4-48a8-be9c-cadec21432f3-kube-api-access-ndd8j\") pod \"cert-manager-webhook-7dc76cbb94-fhx4j\" (UID: \"9174274f-a7b4-48a8-be9c-cadec21432f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.772980 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.772887 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:31.931695 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.931670 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j"] Jun 08 12:02:31.933663 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:02:31.933636 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9174274f_a7b4_48a8_be9c_cadec21432f3.slice/crio-77c7850e9e86f657d18ce405c7013b8b4a69cbaa61c6ae4f109c163777a716ed WatchSource:0}: Error finding container 77c7850e9e86f657d18ce405c7013b8b4a69cbaa61c6ae4f109c163777a716ed: Status 404 returned error can't find the container with id 77c7850e9e86f657d18ce405c7013b8b4a69cbaa61c6ae4f109c163777a716ed Jun 08 12:02:31.992160 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:31.992129 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" event={"ID":"9174274f-a7b4-48a8-be9c-cadec21432f3","Type":"ContainerStarted","Data":"77c7850e9e86f657d18ce405c7013b8b4a69cbaa61c6ae4f109c163777a716ed"} Jun 08 12:02:34.380532 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.380508 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l"] Jun 08 12:02:34.383594 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.383576 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.396240 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.396216 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s5x64\"" Jun 08 12:02:34.414455 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.414391 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l"] Jun 08 12:02:34.471528 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.471501 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.471674 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.471538 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7hp\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-kube-api-access-fm7hp\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.572449 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.572413 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.572612 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.572459 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7hp\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-kube-api-access-fm7hp\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.590547 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.590487 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.590547 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.590493 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7hp\" (UniqueName: \"kubernetes.io/projected/88ff297f-021d-47a6-ab11-a303ec3d3c47-kube-api-access-fm7hp\") pod \"cert-manager-cainjector-5d99449ffd-f2h9l\" (UID: \"88ff297f-021d-47a6-ab11-a303ec3d3c47\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.691765 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.691736 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" Jun 08 12:02:34.849770 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:34.849695 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l"] Jun 08 12:02:34.853379 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:02:34.853335 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ff297f_021d_47a6_ab11_a303ec3d3c47.slice/crio-72be8678fca3ef4bc90052222c130ab36713e39e292b8b709349bf100d90a2fe WatchSource:0}: Error finding container 72be8678fca3ef4bc90052222c130ab36713e39e292b8b709349bf100d90a2fe: Status 404 returned error can't find the container with id 72be8678fca3ef4bc90052222c130ab36713e39e292b8b709349bf100d90a2fe Jun 08 12:02:35.008090 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:35.008052 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" event={"ID":"9174274f-a7b4-48a8-be9c-cadec21432f3","Type":"ContainerStarted","Data":"08f4060bb46ddfb07d21f448e1a093648ea8dff54ec796ed554ac598c03116b7"} Jun 08 12:02:35.008289 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:35.008123 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:35.009572 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:35.009542 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" event={"ID":"88ff297f-021d-47a6-ab11-a303ec3d3c47","Type":"ContainerStarted","Data":"8d889f13974c9f3fbca57f6bb71e863e8a1bd3c7a2af1b5c0ebf8e4b640661fa"} Jun 08 12:02:35.009697 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:35.009576 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" event={"ID":"88ff297f-021d-47a6-ab11-a303ec3d3c47","Type":"ContainerStarted","Data":"72be8678fca3ef4bc90052222c130ab36713e39e292b8b709349bf100d90a2fe"} Jun 08 12:02:35.093999 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:35.093937 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" podStartSLOduration=1.691414006 podStartE2EDuration="4.093916157s" totalImagesPullingTime="2.402502151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:02:35.059012292 +0000 UTC m=+511.443700885" watchObservedRunningTime="2026-06-08 12:02:35.093916157 +0000 UTC m=+511.478604770" Jun 08 12:02:41.018632 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:41.018602 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fhx4j" Jun 08 12:02:41.036892 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:41.036841 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-f2h9l" podStartSLOduration=7.036827341 podStartE2EDuration="7.036827341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:02:35.0966016 +0000 UTC m=+511.481290191" watchObservedRunningTime="2026-06-08 12:02:41.036827341 +0000 UTC m=+517.421515931" Jun 08 12:02:44.889826 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.889795 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm"] Jun 08 12:02:44.892260 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.892238 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:44.894842 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.894821 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:02:44.895842 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.895828 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:02:44.895908 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.895840 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2d9kh\"" Jun 08 12:02:44.903486 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:44.903465 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm"] Jun 08 12:02:45.061169 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.061142 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.061335 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.061187 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.061335 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.061207 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4m72\" (UniqueName: \"kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.162156 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.162121 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.162365 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.162170 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.162365 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.162188 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4m72\" (UniqueName: \"kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.162640 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.162619 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.162705 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.162638 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.170245 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.170215 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4m72\" (UniqueName: \"kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.202027 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.202005 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:45.330395 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:45.330370 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm"] Jun 08 12:02:45.333035 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:02:45.333010 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c621f6_8d55_4f2b_bcfa_754b32ef82bd.slice/crio-8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd WatchSource:0}: Error finding container 8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd: Status 404 returned error can't find the container with id 8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd Jun 08 12:02:46.061487 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:46.061452 2517 generic.go:356] "Generic (PLEG): container finished" podID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerID="2d67345b818a0740e270ea3f48fd457e1c132df26fcde87022b9e7e498cf7149" exitCode=0 Jun 08 12:02:46.061878 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:46.061500 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" event={"ID":"80c621f6-8d55-4f2b-bcfa-754b32ef82bd","Type":"ContainerDied","Data":"2d67345b818a0740e270ea3f48fd457e1c132df26fcde87022b9e7e498cf7149"} Jun 08 12:02:46.061878 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:46.061542 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" event={"ID":"80c621f6-8d55-4f2b-bcfa-754b32ef82bd","Type":"ContainerStarted","Data":"8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd"} Jun 08 12:02:49.077379 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:49.077330 2517 generic.go:356] "Generic (PLEG): container finished" podID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerID="1762f3c55a506bc6e7b690c35b33f9022995ab14a1962f6c69c3eb65e07ac5e2" exitCode=0 Jun 08 12:02:49.077379 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:49.077372 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" event={"ID":"80c621f6-8d55-4f2b-bcfa-754b32ef82bd","Type":"ContainerDied","Data":"1762f3c55a506bc6e7b690c35b33f9022995ab14a1962f6c69c3eb65e07ac5e2"} Jun 08 12:02:50.084322 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:50.084287 2517 generic.go:356] "Generic (PLEG): container finished" podID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerID="ae510021281262a5f2eac7d4f02e9146b9054415a3d3b538076d620b65fd005f" exitCode=0 Jun 08 12:02:50.084716 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:50.084379 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" event={"ID":"80c621f6-8d55-4f2b-bcfa-754b32ef82bd","Type":"ContainerDied","Data":"ae510021281262a5f2eac7d4f02e9146b9054415a3d3b538076d620b65fd005f"} Jun 08 12:02:51.215129 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.215105 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:51.308836 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.308803 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4m72\" (UniqueName: \"kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72\") pod \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " Jun 08 12:02:51.309012 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.308863 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle\") pod \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " Jun 08 12:02:51.309012 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.308894 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util\") pod \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\" (UID: \"80c621f6-8d55-4f2b-bcfa-754b32ef82bd\") " Jun 08 12:02:51.309234 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.309204 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle" (OuterVolumeSpecName: "bundle") pod "80c621f6-8d55-4f2b-bcfa-754b32ef82bd" (UID: "80c621f6-8d55-4f2b-bcfa-754b32ef82bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:02:51.310923 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.310904 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72" (OuterVolumeSpecName: "kube-api-access-m4m72") pod "80c621f6-8d55-4f2b-bcfa-754b32ef82bd" (UID: "80c621f6-8d55-4f2b-bcfa-754b32ef82bd"). InnerVolumeSpecName "kube-api-access-m4m72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:02:51.313267 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.313241 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util" (OuterVolumeSpecName: "util") pod "80c621f6-8d55-4f2b-bcfa-754b32ef82bd" (UID: "80c621f6-8d55-4f2b-bcfa-754b32ef82bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:02:51.409981 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.409953 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4m72\" (UniqueName: \"kubernetes.io/projected/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-kube-api-access-m4m72\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:51.409981 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.409980 2517 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-bundle\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:51.410150 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:51.409992 2517 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c621f6-8d55-4f2b-bcfa-754b32ef82bd-util\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:02:52.095390 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:52.095363 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" Jun 08 12:02:52.095390 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:52.095372 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78et24lm" event={"ID":"80c621f6-8d55-4f2b-bcfa-754b32ef82bd","Type":"ContainerDied","Data":"8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd"} Jun 08 12:02:52.095669 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:52.095421 2517 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eee57e37cf6e3db687700e85f51a545abcf2300a5ad49b676cfb4ab7e372abd" Jun 08 12:02:56.426880 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.426838 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg"] Jun 08 12:02:56.427337 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427322 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="extract" Jun 08 12:02:56.427337 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427359 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="extract" Jun 08 12:02:56.427489 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427381 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="pull" Jun 08 12:02:56.427489 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427390 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="pull" Jun 08 12:02:56.427489 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427419 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="util" Jun 08 12:02:56.427489 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427430 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="util" Jun 08 12:02:56.427731 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.427529 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c621f6-8d55-4f2b-bcfa-754b32ef82bd" containerName="extract" Jun 08 12:02:56.430660 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.430639 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.433566 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.433544 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 08 12:02:56.433676 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.433580 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:02:56.434561 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.434546 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-tmjj2\"" Jun 08 12:02:56.445890 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.445865 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg"] Jun 08 12:02:56.454442 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.454417 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpr8\" (UniqueName: \"kubernetes.io/projected/4c61ba2c-e85b-463a-8642-d82a30aa73c9-kube-api-access-dcpr8\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.454543 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.454486 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c61ba2c-e85b-463a-8642-d82a30aa73c9-tmp\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.555578 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.555546 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpr8\" (UniqueName: \"kubernetes.io/projected/4c61ba2c-e85b-463a-8642-d82a30aa73c9-kube-api-access-dcpr8\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.555741 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.555602 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c61ba2c-e85b-463a-8642-d82a30aa73c9-tmp\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.556003 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.555987 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c61ba2c-e85b-463a-8642-d82a30aa73c9-tmp\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.569566 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.569534 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpr8\" (UniqueName: \"kubernetes.io/projected/4c61ba2c-e85b-463a-8642-d82a30aa73c9-kube-api-access-dcpr8\") pod \"jobset-operator-5bc45f897-nqkqg\" (UID: \"4c61ba2c-e85b-463a-8642-d82a30aa73c9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.739767 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.739671 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" Jun 08 12:02:56.876500 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:56.876476 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg"] Jun 08 12:02:56.878565 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:02:56.878536 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c61ba2c_e85b_463a_8642_d82a30aa73c9.slice/crio-b319dd469fa6add53cad2b5770a698e882bc2e9a8ac444c39fdda774d19a0a0e WatchSource:0}: Error finding container b319dd469fa6add53cad2b5770a698e882bc2e9a8ac444c39fdda774d19a0a0e: Status 404 returned error can't find the container with id b319dd469fa6add53cad2b5770a698e882bc2e9a8ac444c39fdda774d19a0a0e Jun 08 12:02:57.116877 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:02:57.116795 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" event={"ID":"4c61ba2c-e85b-463a-8642-d82a30aa73c9","Type":"ContainerStarted","Data":"b319dd469fa6add53cad2b5770a698e882bc2e9a8ac444c39fdda774d19a0a0e"} Jun 08 12:03:01.138928 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:01.138893 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" event={"ID":"4c61ba2c-e85b-463a-8642-d82a30aa73c9","Type":"ContainerStarted","Data":"61cff1eae8f62c07662398772ba21eccf2237918035d7d19699736221594f345"} Jun 08 12:03:01.160256 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:01.160196 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-nqkqg" podStartSLOduration=1.799780568 podStartE2EDuration="5.160177365s" totalImagesPullingTime="3.360396797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:03:01.159553182 +0000 UTC m=+537.544241773" watchObservedRunningTime="2026-06-08 12:03:01.160177365 +0000 UTC m=+537.544865956" Jun 08 12:03:27.918126 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.918087 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh"] Jun 08 12:03:27.921537 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.921516 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:27.924203 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.924181 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:03:27.925079 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.925054 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 08 12:03:27.925191 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.925054 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 08 12:03:27.925191 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.925112 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:03:27.925191 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.925112 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-dxzph\"" Jun 08 12:03:27.932426 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:27.932405 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh"] Jun 08 12:03:28.022986 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.022956 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4170433d-b0af-45f8-b30f-db072ceda9b9-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.023133 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.023028 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7xf7\" (UniqueName: \"kubernetes.io/projected/4170433d-b0af-45f8-b30f-db072ceda9b9-kube-api-access-d7xf7\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.023133 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.023053 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4170433d-b0af-45f8-b30f-db072ceda9b9-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.124082 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.124049 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7xf7\" (UniqueName: \"kubernetes.io/projected/4170433d-b0af-45f8-b30f-db072ceda9b9-kube-api-access-d7xf7\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.124271 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.124093 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4170433d-b0af-45f8-b30f-db072ceda9b9-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.124271 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.124143 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4170433d-b0af-45f8-b30f-db072ceda9b9-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.124749 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.124728 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4170433d-b0af-45f8-b30f-db072ceda9b9-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.126669 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.126646 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4170433d-b0af-45f8-b30f-db072ceda9b9-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.132246 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.132226 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7xf7\" (UniqueName: \"kubernetes.io/projected/4170433d-b0af-45f8-b30f-db072ceda9b9-kube-api-access-d7xf7\") pod \"kubeflow-trainer-controller-manager-857f77d56c-v8pxh\" (UID: \"4170433d-b0af-45f8-b30f-db072ceda9b9\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.231078 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.231008 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:28.361324 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:28.361276 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh"] Jun 08 12:03:28.363556 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:03:28.363524 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4170433d_b0af_45f8_b30f_db072ceda9b9.slice/crio-bea524011593894dc872a6c6638ce672dd615bbe7432a15cf4fb366080537dd4 WatchSource:0}: Error finding container bea524011593894dc872a6c6638ce672dd615bbe7432a15cf4fb366080537dd4: Status 404 returned error can't find the container with id bea524011593894dc872a6c6638ce672dd615bbe7432a15cf4fb366080537dd4 Jun 08 12:03:29.271960 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:29.271927 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" event={"ID":"4170433d-b0af-45f8-b30f-db072ceda9b9","Type":"ContainerStarted","Data":"bea524011593894dc872a6c6638ce672dd615bbe7432a15cf4fb366080537dd4"} Jun 08 12:03:33.295281 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:33.295240 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" event={"ID":"4170433d-b0af-45f8-b30f-db072ceda9b9","Type":"ContainerStarted","Data":"cd64beba271f5d6eff3f551e015f64d196bfd2b4e3e4a971cc2b890f7159f4ed"} Jun 08 12:03:33.295746 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:33.295325 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:03:33.314299 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:33.314252 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" podStartSLOduration=1.847088117 podStartE2EDuration="6.314239582s" totalImagesPullingTime="4.467151465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:03:33.312582649 +0000 UTC m=+569.697271253" watchObservedRunningTime="2026-06-08 12:03:33.314239582 +0000 UTC m=+569.698928172" Jun 08 12:03:49.303548 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:03:49.303518 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-v8pxh" Jun 08 12:04:04.090162 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:04:04.090135 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 12:04:04.091464 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:04:04.091445 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 12:04:36.923197 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:04:36.923118 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:05:01.944781 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:01.944739 2517 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b65f58d44-4n6nd" podUID="63237d44-3c12-43d9-8dcb-df81d41a556b" containerName="console" containerID="cri-o://8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1" gracePeriod=15 Jun 08 12:05:02.191562 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.191532 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:05:02.309560 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309460 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309560 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309525 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309560 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309553 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309845 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309572 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dztwx\" (UniqueName: \"kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309845 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309604 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309845 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309624 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.309845 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.309650 2517 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config\") pod \"63237d44-3c12-43d9-8dcb-df81d41a556b\" (UID: \"63237d44-3c12-43d9-8dcb-df81d41a556b\") " Jun 08 12:05:02.310126 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.310096 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca" (OuterVolumeSpecName: "service-ca") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:05:02.310126 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.310110 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:05:02.310239 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.310105 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:05:02.310239 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.310202 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config" (OuterVolumeSpecName: "console-config") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:05:02.311892 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.311868 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:05:02.311997 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.311887 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:05:02.311997 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.311897 2517 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx" (OuterVolumeSpecName: "kube-api-access-dztwx") pod "63237d44-3c12-43d9-8dcb-df81d41a556b" (UID: "63237d44-3c12-43d9-8dcb-df81d41a556b"). InnerVolumeSpecName "kube-api-access-dztwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:05:02.411111 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411073 2517 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-oauth-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411111 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411104 2517 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-trusted-ca-bundle\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411111 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411113 2517 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dztwx\" (UniqueName: \"kubernetes.io/projected/63237d44-3c12-43d9-8dcb-df81d41a556b-kube-api-access-dztwx\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411111 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411122 2517 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-service-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411472 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411132 2517 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-oauth-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411472 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411140 2517 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63237d44-3c12-43d9-8dcb-df81d41a556b-console-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.411472 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.411149 2517 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63237d44-3c12-43d9-8dcb-df81d41a556b-console-serving-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 08 12:05:02.710460 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.710430 2517 generic.go:356] "Generic (PLEG): container finished" podID="63237d44-3c12-43d9-8dcb-df81d41a556b" containerID="8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1" exitCode=0 Jun 08 12:05:02.710620 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.710482 2517 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65f58d44-4n6nd" Jun 08 12:05:02.710620 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.710486 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65f58d44-4n6nd" event={"ID":"63237d44-3c12-43d9-8dcb-df81d41a556b","Type":"ContainerDied","Data":"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1"} Jun 08 12:05:02.710620 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.710587 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65f58d44-4n6nd" event={"ID":"63237d44-3c12-43d9-8dcb-df81d41a556b","Type":"ContainerDied","Data":"8528d3698fcf7ea8c581e0a495ac4d24167684ea0850ce46443d3d61137bafc5"} Jun 08 12:05:02.710756 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.710607 2517 scope.go:117] "RemoveContainer" containerID="8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1" Jun 08 12:05:02.719298 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.719277 2517 scope.go:117] "RemoveContainer" containerID="8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1" Jun 08 12:05:02.719670 ip-10-0-140-135 kubenswrapper[2517]: E0608 12:05:02.719654 2517 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1\": container with ID starting with 8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1 not found: ID does not exist" containerID="8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1" Jun 08 12:05:02.719719 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.719693 2517 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1"} err="failed to get container status \"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1\": rpc error: code = NotFound desc = could not find container \"8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1\": container with ID starting with 8eca93b70ac431763eb73629c9115784fe1d967ef74ea718bbdca2c7ddb37ee1 not found: ID does not exist" Jun 08 12:05:02.732364 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.732328 2517 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:05:02.736454 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:02.736433 2517 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b65f58d44-4n6nd"] Jun 08 12:05:04.103533 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:05:04.103505 2517 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63237d44-3c12-43d9-8dcb-df81d41a556b" path="/var/lib/kubelet/pods/63237d44-3c12-43d9-8dcb-df81d41a556b/volumes" Jun 08 12:09:04.119490 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:09:04.119459 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 12:09:04.120438 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:09:04.120417 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 12:10:10.603901 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:10.603869 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-v8pxh_4170433d-b0af-45f8-b30f-db072ceda9b9/manager/0.log" Jun 08 12:10:11.056608 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:11.056584 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-v8pxh_4170433d-b0af-45f8-b30f-db072ceda9b9/manager/0.log" Jun 08 12:10:11.530951 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:11.530925 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-v8pxh_4170433d-b0af-45f8-b30f-db072ceda9b9/manager/0.log" Jun 08 12:10:51.586562 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.586469 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mz2z/must-gather-s89jz"] Jun 08 12:10:51.587460 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.586987 2517 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63237d44-3c12-43d9-8dcb-df81d41a556b" containerName="console" Jun 08 12:10:51.587460 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.587008 2517 state_mem.go:107] "Deleted CPUSet assignment" podUID="63237d44-3c12-43d9-8dcb-df81d41a556b" containerName="console" Jun 08 12:10:51.587460 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.587114 2517 memory_manager.go:368] "RemoveStaleState removing state" podUID="63237d44-3c12-43d9-8dcb-df81d41a556b" containerName="console" Jun 08 12:10:51.590279 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.590258 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.597614 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.597587 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mz2z\"/\"kube-root-ca.crt\"" Jun 08 12:10:51.597713 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.597662 2517 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mz2z\"/\"openshift-service-ca.crt\"" Jun 08 12:10:51.597790 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.597722 2517 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5mz2z\"/\"default-dockercfg-z485w\"" Jun 08 12:10:51.619258 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.619236 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz2z/must-gather-s89jz"] Jun 08 12:10:51.622670 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.622649 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6v9b\" (UniqueName: \"kubernetes.io/projected/dfb0af6e-0ed3-44e3-836e-4e745229580c-kube-api-access-v6v9b\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.622756 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.622686 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfb0af6e-0ed3-44e3-836e-4e745229580c-must-gather-output\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.723308 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.723267 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfb0af6e-0ed3-44e3-836e-4e745229580c-must-gather-output\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.723517 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.723391 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6v9b\" (UniqueName: \"kubernetes.io/projected/dfb0af6e-0ed3-44e3-836e-4e745229580c-kube-api-access-v6v9b\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.723647 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.723624 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfb0af6e-0ed3-44e3-836e-4e745229580c-must-gather-output\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.732943 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.732912 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6v9b\" (UniqueName: \"kubernetes.io/projected/dfb0af6e-0ed3-44e3-836e-4e745229580c-kube-api-access-v6v9b\") pod \"must-gather-s89jz\" (UID: \"dfb0af6e-0ed3-44e3-836e-4e745229580c\") " pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:51.899288 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:51.899262 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz2z/must-gather-s89jz" Jun 08 12:10:52.027103 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:52.027077 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz2z/must-gather-s89jz"] Jun 08 12:10:52.029327 ip-10-0-140-135 kubenswrapper[2517]: W0608 12:10:52.029283 2517 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfb0af6e_0ed3_44e3_836e_4e745229580c.slice/crio-72285bc9f822ad6f9d2f830ef220d2a5b3b568590df1e84d3f9f5f22b7bbf2b7 WatchSource:0}: Error finding container 72285bc9f822ad6f9d2f830ef220d2a5b3b568590df1e84d3f9f5f22b7bbf2b7: Status 404 returned error can't find the container with id 72285bc9f822ad6f9d2f830ef220d2a5b3b568590df1e84d3f9f5f22b7bbf2b7 Jun 08 12:10:52.031145 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:52.031125 2517 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:10:52.291544 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:52.291458 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz2z/must-gather-s89jz" event={"ID":"dfb0af6e-0ed3-44e3-836e-4e745229580c","Type":"ContainerStarted","Data":"72285bc9f822ad6f9d2f830ef220d2a5b3b568590df1e84d3f9f5f22b7bbf2b7"} Jun 08 12:10:53.300071 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:53.299977 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz2z/must-gather-s89jz" event={"ID":"dfb0af6e-0ed3-44e3-836e-4e745229580c","Type":"ContainerStarted","Data":"5b39df999d5411f41a1c6b203778e833a0cbf5eaf9f2978e05822a6844e60b4e"} Jun 08 12:10:53.300071 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:53.300034 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz2z/must-gather-s89jz" event={"ID":"dfb0af6e-0ed3-44e3-836e-4e745229580c","Type":"ContainerStarted","Data":"5db62c1513be451c790114bac329285b59a170e2a6fec8b7d45239934bb140ab"} Jun 08 12:10:54.382335 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:54.382304 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2z2lb_04bbd309-255e-4afe-8ab8-2d519b3d27df/global-pull-secret-syncer/0.log" Jun 08 12:10:54.543035 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:54.543008 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jl9t8_54849acf-4f0e-4e5f-8dff-eb02a108e9b8/konnectivity-agent/0.log" Jun 08 12:10:54.625977 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:54.625951 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-135.ec2.internal_2800005ebd22734ffdd825485f6a9839/haproxy/0.log" Jun 08 12:10:58.178769 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.178727 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/alertmanager/0.log" Jun 08 12:10:58.214272 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.214245 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/config-reloader/0.log" Jun 08 12:10:58.239864 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.239801 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/kube-rbac-proxy-web/0.log" Jun 08 12:10:58.271955 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.271923 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/kube-rbac-proxy/0.log" Jun 08 12:10:58.299638 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.299610 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/kube-rbac-proxy-metric/0.log" Jun 08 12:10:58.324907 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.324878 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/prom-label-proxy/0.log" Jun 08 12:10:58.351770 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.351713 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88441795-fd58-4821-8786-8dd7822ca896/init-config-reloader/0.log" Jun 08 12:10:58.397301 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.397269 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-m5t7x_6b168690-c2a7-456d-9abc-fc3d146411ed/cluster-monitoring-operator/0.log" Jun 08 12:10:58.597512 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.597437 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-267wm_ee594516-9f90-46d3-a2bd-ac24f7efe81d/node-exporter/0.log" Jun 08 12:10:58.626361 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.626303 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-267wm_ee594516-9f90-46d3-a2bd-ac24f7efe81d/kube-rbac-proxy/0.log" Jun 08 12:10:58.654374 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.654337 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-267wm_ee594516-9f90-46d3-a2bd-ac24f7efe81d/init-textfile/0.log" Jun 08 12:10:58.844994 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.844964 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwwkn_8493105b-cebb-42fc-9a1f-6fb06f37d58b/kube-rbac-proxy-main/0.log" Jun 08 12:10:58.876234 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.876154 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwwkn_8493105b-cebb-42fc-9a1f-6fb06f37d58b/kube-rbac-proxy-self/0.log" Jun 08 12:10:58.905711 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:58.905683 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwwkn_8493105b-cebb-42fc-9a1f-6fb06f37d58b/openshift-state-metrics/0.log" Jun 08 12:10:59.192037 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.192005 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-lmwgt_c75ac4cc-ed4f-4a09-91c6-a78d184bcfb4/prometheus-operator-admission-webhook/0.log" Jun 08 12:10:59.312701 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.312676 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/thanos-query/0.log" Jun 08 12:10:59.335516 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.335477 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/kube-rbac-proxy-web/0.log" Jun 08 12:10:59.360508 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.360485 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/kube-rbac-proxy/0.log" Jun 08 12:10:59.383955 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.383927 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/prom-label-proxy/0.log" Jun 08 12:10:59.410293 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.410252 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/kube-rbac-proxy-rules/0.log" Jun 08 12:10:59.437656 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:10:59.437631 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59d85dd4b8-t2jtc_202d416a-0baa-41d4-a206-0993765117a8/kube-rbac-proxy-metrics/0.log" Jun 08 12:11:00.708955 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:00.708897 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-wlm6j_559652cd-a785-43e2-b4a2-883aa3bdc5e2/networking-console-plugin/0.log" Jun 08 12:11:01.554543 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.554511 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-7d4tr_a333f3bc-7324-4931-be86-33d578070989/download-server/0.log" Jun 08 12:11:01.842211 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.842111 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mz2z/must-gather-s89jz" podStartSLOduration=9.847457253 podStartE2EDuration="10.842091623s" totalImagesPullingTime="994.63437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:53.326808899 +0000 UTC m=+1009.711497481" watchObservedRunningTime="2026-06-08 12:11:01.842091623 +0000 UTC m=+1018.226780213" Jun 08 12:11:01.842980 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.842958 2517 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867"] Jun 08 12:11:01.848811 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.848783 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:01.857977 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.857951 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867"] Jun 08 12:11:01.921564 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.921525 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-lib-modules\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:01.921882 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.921859 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-podres\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:01.922115 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.922094 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq8qb\" (UniqueName: \"kubernetes.io/projected/e6254d69-45eb-4b15-97ae-072d40552a9b-kube-api-access-hq8qb\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:01.922361 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.922324 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-proc\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:01.922527 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:01.922511 2517 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-sys\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023725 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023690 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq8qb\" (UniqueName: \"kubernetes.io/projected/e6254d69-45eb-4b15-97ae-072d40552a9b-kube-api-access-hq8qb\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023932 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023762 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-proc\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023932 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023783 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-sys\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023932 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023804 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-lib-modules\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023932 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023820 2517 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-podres\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.023932 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023896 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-sys\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.024204 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023900 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-proc\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.024204 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023941 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-podres\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.024204 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.023954 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6254d69-45eb-4b15-97ae-072d40552a9b-lib-modules\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.033270 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.033232 2517 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq8qb\" (UniqueName: \"kubernetes.io/projected/e6254d69-45eb-4b15-97ae-072d40552a9b-kube-api-access-hq8qb\") pod \"perf-node-gather-daemonset-rs867\" (UID: \"e6254d69-45eb-4b15-97ae-072d40552a9b\") " pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.097819 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.097734 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-qdqvb_21faab80-2ec7-4a98-84fc-99011dab2caf/volume-data-source-validator/0.log" Jun 08 12:11:02.163100 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.163066 2517 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:02.328255 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.328222 2517 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867"] Jun 08 12:11:02.354394 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.354368 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" event={"ID":"e6254d69-45eb-4b15-97ae-072d40552a9b","Type":"ContainerStarted","Data":"6a0532fa7594e9c6cf9bdaf6724aaf7eb83a2f2b655ef27dfe5b48b4e050488c"} Jun 08 12:11:02.940332 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.940306 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlwsj_3f7028b9-c116-490f-b863-8b6f3adb8d82/dns/0.log" Jun 08 12:11:02.960385 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:02.960359 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlwsj_3f7028b9-c116-490f-b863-8b6f3adb8d82/kube-rbac-proxy/0.log" Jun 08 12:11:03.042008 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:03.041984 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-64947_f6af153f-e31d-4b1f-a657-b3a503a0fc6e/dns-node-resolver/0.log" Jun 08 12:11:03.363379 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:03.363275 2517 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" event={"ID":"e6254d69-45eb-4b15-97ae-072d40552a9b","Type":"ContainerStarted","Data":"5e198821c280b7c7629ddd2346ce0836e90210b09ed093765780d2ab10008946"} Jun 08 12:11:03.363555 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:03.363459 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:03.379330 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:03.379277 2517 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" podStartSLOduration=2.379255561 podStartE2EDuration="2.379255561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:11:03.378051286 +0000 UTC m=+1019.762739876" watchObservedRunningTime="2026-06-08 12:11:03.379255561 +0000 UTC m=+1019.763944154" Jun 08 12:11:03.501681 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:03.501652 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f7r5_4339b76c-e12e-4cdc-8dac-bd49d618f7a8/node-ca/0.log" Jun 08 12:11:04.596173 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:04.596141 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqmh_6f21d298-2c6b-405e-bae4-30796db38eec/serve-healthcheck-canary/0.log" Jun 08 12:11:04.965047 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:04.965016 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-n7mhp_e23505ba-9475-46d9-af7b-22b07c542d22/insights-operator/0.log" Jun 08 12:11:04.965275 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:04.965253 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-n7mhp_e23505ba-9475-46d9-af7b-22b07c542d22/insights-operator/1.log" Jun 08 12:11:05.053754 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:05.053730 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlbmh_3e338af3-d254-47e2-953b-351060b988a3/kube-rbac-proxy/0.log" Jun 08 12:11:05.075400 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:05.075380 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlbmh_3e338af3-d254-47e2-953b-351060b988a3/exporter/0.log" Jun 08 12:11:05.098964 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:05.098941 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlbmh_3e338af3-d254-47e2-953b-351060b988a3/extractor/0.log" Jun 08 12:11:06.860479 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:06.860451 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-nqkqg_4c61ba2c-e85b-463a-8642-d82a30aa73c9/jobset-operator/0.log" Jun 08 12:11:09.379048 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:09.379022 2517 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5mz2z/perf-node-gather-daemonset-rs867" Jun 08 12:11:10.277152 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:10.277076 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wfmqr_7891aeda-35a2-406b-870d-a527867dcd77/kube-storage-version-migrator-operator/1.log" Jun 08 12:11:10.279186 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:10.279131 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wfmqr_7891aeda-35a2-406b-870d-a527867dcd77/kube-storage-version-migrator-operator/0.log" Jun 08 12:11:11.340285 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.340251 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5mtmv_bf9b9729-7b16-41b2-85e2-d2bf4a6f7c37/kube-multus/0.log" Jun 08 12:11:11.395336 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.395309 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/kube-multus-additional-cni-plugins/0.log" Jun 08 12:11:11.419048 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.419016 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/egress-router-binary-copy/0.log" Jun 08 12:11:11.444946 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.444918 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/cni-plugins/0.log" Jun 08 12:11:11.469874 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.469852 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/bond-cni-plugin/0.log" Jun 08 12:11:11.494747 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.494711 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/routeoverride-cni/0.log" Jun 08 12:11:11.518609 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.518582 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/whereabouts-cni-bincopy/0.log" Jun 08 12:11:11.546504 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:11.546484 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b22hk_7ee3fc0e-a066-471f-a460-735882cd7ae3/whereabouts-cni/0.log" Jun 08 12:11:12.160593 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:12.160562 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vhzrt_7031fce5-b92d-4dc3-a5cf-ac1dbf238b90/network-metrics-daemon/0.log" Jun 08 12:11:12.184192 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:12.184161 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vhzrt_7031fce5-b92d-4dc3-a5cf-ac1dbf238b90/kube-rbac-proxy/0.log" Jun 08 12:11:13.436920 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.436828 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-controller/0.log" Jun 08 12:11:13.454904 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.454881 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/1.log" Jun 08 12:11:13.455036 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.455019 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovn-acl-logging/0.log" Jun 08 12:11:13.475355 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.475321 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/kube-rbac-proxy-node/0.log" Jun 08 12:11:13.495182 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.495157 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 12:11:13.512375 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.512353 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/northd/0.log" Jun 08 12:11:13.533158 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.533136 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/nbdb/0.log" Jun 08 12:11:13.554724 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.554704 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/sbdb/0.log" Jun 08 12:11:13.595733 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:13.595709 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w89bg_9f85a973-ad42-4680-b266-5e186db06134/ovnkube-controller/0.log" Jun 08 12:11:14.533648 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:14.533622 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-mxlzc_cd1ca8a0-1604-4918-93b9-cc5fd223ac67/check-endpoints/0.log" Jun 08 12:11:14.592029 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:14.592002 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gbl27_aa485ad7-1705-4f82-8086-cae0fc0e1bea/network-check-target-container/0.log" Jun 08 12:11:15.518538 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:15.518513 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gfdhf_16a9f6c7-d1e0-4ce8-9e02-2151146ee47a/iptables-alerter/0.log" Jun 08 12:11:16.157436 ip-10-0-140-135 kubenswrapper[2517]: I0608 12:11:16.157402 2517 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lr4v6_90272da9-3221-40e8-85d0-e35d518945c9/tuned/0.log"