Jun 09 09:30:13.415641 ip-10-0-133-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 09:30:13.415649 ip-10-0-133-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 09:30:13.415659 ip-10-0-133-109 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 09:30:13.415872 ip-10-0-133-109 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 09:30:23.568583 ip-10-0-133-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 09:30:23.568605 ip-10-0-133-109 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 88c05a3286134bf7b6c50baaa5d6eaf3 -- Jun 09 09:32:40.724423 ip-10-0-133-109 systemd[1]: Starting Kubernetes Kubelet... Jun 09 09:32:41.167645 ip-10-0-133-109 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:32:41.167645 ip-10-0-133-109 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 09:32:41.167645 ip-10-0-133-109 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:32:41.167645 ip-10-0-133-109 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 09:32:41.167645 ip-10-0-133-109 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:32:41.168827 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.168608 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 09:32:41.176057 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176035 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.176057 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176051 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.176057 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176055 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.176057 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176058 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176063 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176068 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176071 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176075 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176078 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176082 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176085 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176088 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176091 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176095 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176097 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176100 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176103 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176105 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176108 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176110 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176114 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176116 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.176188 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176129 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176132 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176135 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176138 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176140 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176143 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176146 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176148 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176151 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176154 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176156 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176159 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176161 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176164 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176166 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176171 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176173 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176176 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176179 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176181 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.176638 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176185 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176188 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176191 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176193 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176196 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176199 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176202 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176204 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176207 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176209 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176212 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176215 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176217 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176219 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176222 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176224 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176227 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176230 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176232 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176234 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.177139 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176237 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176239 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176242 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176244 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176247 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176249 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176252 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176255 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176258 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176261 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176264 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176269 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176271 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176274 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176277 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176279 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176283 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176287 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176289 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.177634 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176292 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176295 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176297 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176300 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176302 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176305 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176307 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176311 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176313 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176316 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176318 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176321 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176323 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176326 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176329 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176331 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.178165 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.176334 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.178657 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178644 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.178657 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178656 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178660 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178662 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178665 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178668 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178671 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178674 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178676 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178679 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178681 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178684 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178686 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178689 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178691 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178694 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178696 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178699 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178701 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178704 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178706 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.178712 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178709 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178712 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178714 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178717 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178720 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178722 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178725 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178728 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178730 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178733 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178735 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178738 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178740 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178743 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178745 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178748 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178750 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178753 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178756 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178758 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.179225 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178761 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178763 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178766 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178768 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178771 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178773 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178777 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178781 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178784 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178787 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178790 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178792 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178795 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178797 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178800 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178803 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178805 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178808 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178811 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.179716 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178813 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178816 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178818 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178821 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178824 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178828 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178831 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178833 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178837 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178840 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178842 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178846 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178848 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178851 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178853 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178855 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178858 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178860 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178863 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.180204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178865 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178868 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178870 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178873 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178875 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178877 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178880 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178883 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178886 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178889 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178892 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178894 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178897 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178900 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178904 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178906 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178909 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178911 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178914 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.178916 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.180672 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179292 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179297 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179300 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179302 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179306 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179309 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179312 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179314 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179317 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179319 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179322 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179325 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179327 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179330 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179332 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179335 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179337 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179340 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179342 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179345 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.181222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179349 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179353 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179357 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179361 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179363 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179366 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179368 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179371 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179374 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179376 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179378 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179381 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179383 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179386 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179388 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179391 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179393 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179397 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179400 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179402 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.181714 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179405 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179408 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179411 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179413 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179416 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179419 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179422 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179424 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179427 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179430 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179432 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179436 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179438 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179441 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179444 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179447 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179449 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179452 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179454 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.182222 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179457 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179460 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179462 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179465 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179467 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179470 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179473 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179475 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179478 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179481 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179484 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179486 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179489 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179491 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179494 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179496 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179499 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179501 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179504 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179506 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.182675 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179509 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179511 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179514 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179516 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179519 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179521 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179524 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179527 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179529 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179532 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179536 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179539 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179542 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179546 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179550 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179553 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179556 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179559 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179561 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.183204 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.179564 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179650 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179657 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179663 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179669 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179674 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179678 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179682 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179686 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179689 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179693 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179696 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179700 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179704 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179707 2560 flags.go:64] FLAG: --cgroup-root="" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179709 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179713 2560 flags.go:64] FLAG: --client-ca-file="" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179715 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179719 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179723 2560 flags.go:64] FLAG: --cluster-domain="" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179727 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179730 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179733 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179736 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 09:32:41.183667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179740 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179743 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179750 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179753 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179756 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179760 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179763 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179766 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179769 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179774 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179777 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179780 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179783 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179786 2560 flags.go:64] FLAG: --enable-server="true" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179792 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179797 2560 flags.go:64] FLAG: --event-burst="100" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179800 2560 flags.go:64] FLAG: --event-qps="50" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179803 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179806 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179808 2560 flags.go:64] FLAG: --eviction-hard="" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179812 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179815 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179818 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179821 2560 flags.go:64] FLAG: --eviction-soft="" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179824 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 09:32:41.184261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179827 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179830 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179833 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179836 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179838 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179841 2560 flags.go:64] FLAG: --feature-gates="" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179845 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179848 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179852 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179857 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179860 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179863 2560 flags.go:64] FLAG: --help="false" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179866 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179869 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179872 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179875 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179879 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179882 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179885 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179898 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179901 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179906 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179910 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179913 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 09:32:41.184882 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179917 2560 flags.go:64] FLAG: --kube-reserved="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179920 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179923 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179926 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179929 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179932 2560 flags.go:64] FLAG: --lock-file="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179934 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179937 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179941 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179946 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179949 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179952 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179955 2560 flags.go:64] FLAG: --logging-format="text" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179958 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179961 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179964 2560 flags.go:64] FLAG: --manifest-url="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179967 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179973 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179976 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179980 2560 flags.go:64] FLAG: --max-pods="110" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179983 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179986 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179989 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179992 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179995 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 09:32:41.185483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.179998 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180001 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180008 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180011 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180016 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180019 2560 flags.go:64] FLAG: --pod-cidr="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180022 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180028 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180031 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180034 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180037 2560 flags.go:64] FLAG: --port="10250" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180040 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180043 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0376439655414c5c0" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180046 2560 flags.go:64] FLAG: --qos-reserved="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180049 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180052 2560 flags.go:64] FLAG: --register-node="true" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180055 2560 flags.go:64] FLAG: --register-with-taints="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180058 2560 flags.go:64] FLAG: --registry-burst="10" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180061 2560 flags.go:64] FLAG: --registry-qps="5" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180064 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180067 2560 flags.go:64] FLAG: --reserved-memory="" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180071 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180074 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180077 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180081 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 09:32:41.186106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180084 2560 flags.go:64] FLAG: --runonce="false" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180087 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180091 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180094 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180096 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180100 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180103 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180106 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180109 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180112 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180115 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180130 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180135 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180138 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180141 2560 flags.go:64] FLAG: --system-cgroups="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180146 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180166 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180169 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180172 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180178 2560 flags.go:64] FLAG: --tls-min-version="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180181 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180183 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180186 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180189 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180192 2560 flags.go:64] FLAG: --v="2" Jun 09 09:32:41.186811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180196 2560 flags.go:64] FLAG: --version="false" Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180200 2560 flags.go:64] FLAG: --vmodule="" Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180203 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180207 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180320 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180324 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180327 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180333 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180337 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180340 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180343 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180347 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180350 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180352 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180355 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180357 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180360 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180363 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180365 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180370 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.187462 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180373 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180376 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180379 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180381 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180384 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180387 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180389 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180392 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180394 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180397 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180400 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180402 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180405 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180407 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180410 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180412 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180415 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180417 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180420 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180426 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.187947 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180429 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180431 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180434 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180436 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180439 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180441 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180443 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180446 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180449 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180451 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180454 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180458 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180460 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180463 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180465 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180468 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180471 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180474 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180477 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.188452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180479 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180482 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180484 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180487 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180490 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180492 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180495 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180497 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180500 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180502 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180505 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180507 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180511 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180515 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180519 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180521 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180524 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180526 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180529 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180532 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.188932 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180535 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180537 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180540 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180542 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180546 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180549 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180552 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180555 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180558 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180561 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180564 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180566 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180569 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180571 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180574 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180576 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180579 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180582 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180584 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180588 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.189430 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180591 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180594 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180597 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.180600 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.180606 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188136 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188154 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188173 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188179 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188239 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188244 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188248 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188251 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188255 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.189911 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188259 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188262 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188264 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188267 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188270 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188273 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188276 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188279 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188282 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188284 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188287 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188289 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188292 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188295 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188298 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188300 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188303 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188305 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188308 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188311 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.190307 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188313 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188316 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188318 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188321 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188329 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188332 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188335 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188338 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188340 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188343 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188345 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188348 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188351 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188353 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188356 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188360 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188363 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188366 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188368 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188371 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.190784 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188374 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188376 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188378 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188381 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188384 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188387 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188389 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188392 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188394 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188397 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188399 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188402 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188405 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188407 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188409 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188412 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188415 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188424 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188427 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188430 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.191355 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188432 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188435 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188437 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188440 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188442 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188445 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188448 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188451 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188453 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188456 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188459 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188461 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188464 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188468 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188470 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188473 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188477 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188481 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188484 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.191868 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188487 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188495 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188499 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188502 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188504 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188507 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188509 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188512 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188514 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188517 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188520 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188528 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188531 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188534 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188536 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.192333 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188541 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188686 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188691 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188694 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188697 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188700 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188703 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188706 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188708 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188711 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188713 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188716 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188718 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188721 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188723 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188726 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188729 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188731 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188734 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188737 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:32:41.192738 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188739 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188742 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188745 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188747 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188750 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188752 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188755 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188758 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188760 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188768 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188771 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188774 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188776 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188779 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188781 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188784 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188786 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188789 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188791 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:32:41.193310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188794 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188796 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188799 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188801 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188805 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188808 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188811 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188814 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188817 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188821 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188824 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188827 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188830 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188832 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188835 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188837 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188840 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188842 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188845 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:32:41.193796 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188847 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188850 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188853 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188855 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188863 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188866 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188868 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188871 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188873 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188876 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188878 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188881 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188884 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188886 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188888 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188891 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188893 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188896 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188898 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:32:41.194461 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188901 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188903 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188906 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188908 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188911 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188913 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188916 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188918 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188921 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188924 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188928 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188930 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188933 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188936 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188938 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188941 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188944 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188946 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188954 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188957 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:32:41.195172 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188959 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:32:41.195728 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188962 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:32:41.195728 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:41.188964 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:32:41.195728 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.188969 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:32:41.195728 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.189084 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 09:32:41.195728 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.192465 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 09:32:41.196182 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.196146 2560 server.go:1019] "Starting client certificate rotation" Jun 09 09:32:41.196385 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.196365 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:32:41.196439 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.196417 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:32:41.199260 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.199222 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:32:41.200374 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.200356 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:32:41.211161 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.211140 2560 log.go:25] "Validated CRI v1 runtime API" Jun 09 09:32:41.214384 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.214368 2560 log.go:25] "Validated CRI v1 image API" Jun 09 09:32:41.215203 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.215188 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 09:32:41.217779 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.217761 2560 fs.go:135] Filesystem UUIDs: map[064e511b-9b13-49af-ba54-d363f5ba34e7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ab07854a-e2ca-4a7b-96c2-a347d36c557f:/dev/nvme0n1p3] Jun 09 09:32:41.217837 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.217780 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 09:32:41.223526 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.223410 2560 manager.go:216] Machine: {Timestamp:2026-06-09 09:32:41.221976954 +0000 UTC m=+0.369385308 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100101 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c17cef8dd11ce5448239f982ec092 SystemUUID:ec2c17ce-f8dd-11ce-5448-239f982ec092 BootID:88c05a32-8613-4bf7-b6c5-0baaa5d6eaf3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:1e:45:fe:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:1e:45:fe:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:02:d0:52:da:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 09:32:41.223526 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.223525 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 09:32:41.223633 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.223605 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 09:32:41.224332 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.224316 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:32:41.227044 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.227017 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 09:32:41.227208 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.227047 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 09:32:41.227909 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.227899 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 09:32:41.227943 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.227911 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 09:32:41.227943 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.227923 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:32:41.228583 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.228573 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:32:41.229803 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.229793 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 09:32:41.234069 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234059 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:32:41.234200 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234190 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 09:32:41.234253 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234246 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 09 09:32:41.234282 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234263 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 09:32:41.234282 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234280 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 09:32:41.234342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234290 2560 kubelet.go:398] "Adding apiserver pod source" Jun 09 09:32:41.234342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.234298 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 09:32:41.235668 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.235646 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:32:41.235739 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.235680 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:32:41.240219 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.240198 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 09:32:41.241888 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.241874 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 09:32:41.241950 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.241904 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 09:32:41.242759 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242741 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 09:32:41.242759 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242761 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242768 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242775 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242784 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242790 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242797 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242802 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242809 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242815 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242823 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 09:32:41.242863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.242828 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 09:32:41.243576 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.243554 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 09:32:41.243647 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.243598 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 09:32:41.243746 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.243736 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 09:32:41.243746 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.243746 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 09:32:41.245762 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.245745 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 09:32:41.246771 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.246758 2560 server.go:1268] "Started kubelet" Jun 09 09:32:41.246836 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.246814 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 09:32:41.246888 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.246823 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 09:32:41.246937 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.246894 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 09:32:41.247533 ip-10-0-133-109 systemd[1]: Started Kubernetes Kubelet. Jun 09 09:32:41.249061 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.249048 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 09 09:32:41.251342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.251327 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 09:32:41.255328 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.255305 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 09:32:41.257475 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.256382 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-109.ec2.internal.18b75fd887f2ccd9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-109.ec2.internal,UID:ip-10-0-133-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-109.ec2.internal,},FirstTimestamp:2026-06-09 09:32:41.246731481 +0000 UTC m=+0.394139808,LastTimestamp:2026-06-09 09:32:41.246731481 +0000 UTC m=+0.394139808,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-109.ec2.internal,}" Jun 09 09:32:41.258619 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.258599 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 09:32:41.258619 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.258606 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 09:32:41.258752 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.258697 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.259362 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259345 2560 factory.go:55] Registering systemd factory Jun 09 09:32:41.259464 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259366 2560 factory.go:223] Registration of the systemd container factory successfully Jun 09 09:32:41.259464 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259423 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 09:32:41.259464 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259424 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 09:32:41.259464 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259446 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 09:32:41.259655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259555 2560 factory.go:153] Registering CRI-O factory Jun 09 09:32:41.259655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259568 2560 factory.go:223] Registration of the crio container factory successfully Jun 09 09:32:41.259655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259619 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 09:32:41.259655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259640 2560 factory.go:103] Registering Raw factory Jun 09 09:32:41.259655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.259656 2560 manager.go:1196] Started watching for new ooms in manager Jun 09 09:32:41.260073 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.260057 2560 manager.go:349] Starting recovery of all containers Jun 09 09:32:41.260147 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.260095 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 09 09:32:41.260147 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.260105 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 09 09:32:41.260494 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.260470 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 09:32:41.260598 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.260574 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 09:32:41.270368 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.270195 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jskfb" Jun 09 09:32:41.270480 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.270469 2560 manager.go:354] Recovery completed Jun 09 09:32:41.274481 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.274467 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.276054 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276037 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jskfb" Jun 09 09:32:41.276422 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276405 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.276493 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276439 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.276493 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276455 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.276977 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276962 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 09:32:41.276977 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276974 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 09:32:41.277086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276994 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:32:41.277086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.276996 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.277661 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.277645 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.277711 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.277672 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.277711 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.277682 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.279028 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.279015 2560 policy_none.go:49] "None policy: Start" Jun 09 09:32:41.279101 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.279033 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 09:32:41.279101 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.279046 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 09:32:41.280794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.280781 2560 policy_none.go:47] "Start" Jun 09 09:32:41.318725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.318709 2560 manager.go:337] "Starting Device Plugin manager" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.318749 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.318759 2560 server.go:87] "Starting device plugin registration server" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.319000 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.319017 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.319089 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.319176 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.319186 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.319697 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.319736 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.327461 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.328665 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.328709 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.328733 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.328773 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 09:32:41.337811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.331001 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:41.419388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.419314 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.420799 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.420785 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.420864 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.420814 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.420864 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.420823 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.420864 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.420845 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.429250 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.429232 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal"] Jun 09 09:32:41.429319 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.429288 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.430035 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.430021 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.430095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.430049 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.430095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.430063 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.431134 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.431111 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.431181 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.431141 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-109.ec2.internal\": node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.432415 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.432404 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.432510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.432498 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.432571 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.432524 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.433039 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433023 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.433103 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433023 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.433103 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433072 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.433103 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433084 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.433217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433050 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.433217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.433143 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.435282 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.435265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.435369 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.435295 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:32:41.435871 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.435856 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:32:41.435950 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.435885 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:32:41.435950 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.435898 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:32:41.461469 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.461451 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.461469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.461450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.461572 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.461501 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.461572 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.461520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.464836 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.464817 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-109.ec2.internal\" not found" node="ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.469132 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.469106 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-109.ec2.internal\" not found" node="ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.561867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.561839 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.561986 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.561881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.561986 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.561960 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.562318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.562200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.563590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.562321 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.563590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.562422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.563590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.562393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.662298 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.662253 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.762994 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.762931 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.772164 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.772148 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.776113 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:41.776096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:41.863628 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.863596 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:41.964057 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:41.964031 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:42.064577 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.064515 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 09:32:42.119682 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.119656 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:42.159541 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.159515 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 09:32:42.172486 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.172465 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:32:42.174426 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.174412 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 09:32:42.182866 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.182852 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:32:42.194993 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.194977 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 09:32:42.195156 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.195115 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:32:42.195217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.195146 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:32:42.235292 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.235255 2560 apiserver.go:52] "Watching apiserver" Jun 09 09:32:42.256663 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.256638 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 09:32:42.258518 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.258498 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gjgq6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk","openshift-cluster-node-tuning-operator/tuned-fqvbz","openshift-dns/node-resolver-sphx6","openshift-multus/multus-2lsn5","openshift-multus/multus-additional-cni-plugins-szqfv","openshift-multus/network-metrics-daemon-rm8lp","openshift-network-diagnostics/network-check-target-7zbbc","kube-system/global-pull-secret-syncer-kcphz","kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal","openshift-image-registry/node-ca-4l64c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal","openshift-network-operator/iptables-alerter-9p5x2","openshift-ovn-kubernetes/ovnkube-node-k46n4"] Jun 09 09:32:42.258839 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.258823 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 09:32:42.261201 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.261184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.261271 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.261255 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:42.263106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.263087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.265169 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265134 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.265640 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265623 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 09:32:42.265732 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265688 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.265788 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265688 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.265788 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265740 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hfswg\"" Jun 09 09:32:42.265905 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.265969 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.265921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmp7\" (UniqueName: \"kubernetes.io/projected/6460d810-7ac0-4a30-81c0-3bc4f4454707-kube-api-access-sbmp7\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.267683 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.267562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.267683 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.267562 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ggd4z\"" Jun 09 09:32:42.267683 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.267569 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.268034 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.268019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.269132 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.269105 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:32:42.270270 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.270252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.270498 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.270431 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.270589 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.270507 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmgdv\"" Jun 09 09:32:42.271046 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.271031 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.272987 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.272771 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.272987 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.272828 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 09:32:42.272987 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.272932 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.272987 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.272779 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 09:32:42.273239 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.273212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.273610 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.273588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c657h\"" Jun 09 09:32:42.275527 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.275509 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwkb9\"" Jun 09 09:32:42.275616 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.275512 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 09:32:42.275616 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.275562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 09:32:42.275616 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.275579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.275774 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.275693 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:42.277633 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.277614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.279971 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.279935 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 09:27:41 +0000 UTC" deadline="2027-11-03 13:22:11.879916272 +0000 UTC" Jun 09 09:32:42.279971 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.279970 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12291h49m29.599949794s" Jun 09 09:32:42.280098 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.280005 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 09:32:42.280334 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.280320 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z69bv\"" Jun 09 09:32:42.280334 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.280327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.280451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.280389 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 09:32:42.282654 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.282638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.283133 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.283105 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.283133 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.283116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.283306 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.283260 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 09:32:42.283306 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.283303 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bdrmr\"" Jun 09 09:32:42.284832 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.284818 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.284972 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.284957 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d6sgl\"" Jun 09 09:32:42.285042 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.284960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.285341 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.285324 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 09:32:42.285341 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.285337 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.285428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.285362 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 09:32:42.285824 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.285810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 09:32:42.285897 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.285883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 09:32:42.287109 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.287096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:42.287201 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.287163 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:42.287502 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.287486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 09:32:42.287557 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.287492 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 09:32:42.287557 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.287526 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 09:32:42.287557 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.287528 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fg5tf\"" Jun 09 09:32:42.294601 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.294587 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tz8cs" Jun 09 09:32:42.304431 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.304408 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tz8cs" Jun 09 09:32:42.337295 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.337258 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627b185f30291ffb2e9813e90451a240.slice/crio-ba9fb1602a3f9d703420b258a1c3a8102bb1e3d1ebb7d2b3df9bd44ce4064a80 WatchSource:0}: Error finding container ba9fb1602a3f9d703420b258a1c3a8102bb1e3d1ebb7d2b3df9bd44ce4064a80: Status 404 returned error can't find the container with id ba9fb1602a3f9d703420b258a1c3a8102bb1e3d1ebb7d2b3df9bd44ce4064a80 Jun 09 09:32:42.337628 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.337610 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae446967242a088e635b73955367e69.slice/crio-83940dcd1452f95cce326bdacf6b281496dd81500fa55add893bd4e4d358cac7 WatchSource:0}: Error finding container 83940dcd1452f95cce326bdacf6b281496dd81500fa55add893bd4e4d358cac7: Status 404 returned error can't find the container with id 83940dcd1452f95cce326bdacf6b281496dd81500fa55add893bd4e4d358cac7 Jun 09 09:32:42.342711 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.342398 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:32:42.360234 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.360220 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 09:32:42.366177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366155 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.366293 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366293 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366293 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cnibin\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.366293 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366293 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-netns\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn8tn\" (UniqueName: \"kubernetes.io/projected/846c9a35-0f7c-4364-a31b-8b6693865f7d-kube-api-access-pn8tn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysconfig\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-systemd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-lib-modules\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-tuned\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-kubelet\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-conf-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366462 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-kubelet-config\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366474 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-script-lib\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-serviceca\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482s5\" (UniqueName: \"kubernetes.io/projected/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-kube-api-access-482s5\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-device-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-ovn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-multus\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-os-release\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-os-release\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-tmp\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-socket-dir-parent\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.366725 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366718 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-config\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovn-node-metrics-cert\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-modprobe-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366795 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-system-cni-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00be341c-74ff-47cb-b9e8-236f4cf6f96e-hosts-file\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-hostroot\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-var-lib-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-iptables-alerter-script\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-run\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.366992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z8jd\" (UniqueName: \"kubernetes.io/projected/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-kube-api-access-4z8jd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-k8s-cni-cncf-io\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-slash\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-host\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.367098 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-var-lib-kubelet\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367182 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-bin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.367205 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:42.867190653 +0000 UTC m=+2.014598967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-dbus\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a2b6496-7511-4181-9ab7-f527a0983fb5-konnectivity-ca\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-systemd-units\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-node-log\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-netd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367334 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-system-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-etc-kubernetes\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-etc-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-log-socket\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kb9\" (UniqueName: \"kubernetes.io/projected/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-kube-api-access-v7kb9\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-host\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ppp\" (UniqueName: \"kubernetes.io/projected/00be341c-74ff-47cb-b9e8-236f4cf6f96e-kube-api-access-n5ppp\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nw4p\" (UniqueName: \"kubernetes.io/projected/35de1da8-63e8-4820-9632-6b2bcee5378c-kube-api-access-8nw4p\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.367892 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-netns\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-bin\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-kubernetes\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-registration-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-kubelet\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-cni-binary-copy\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-socket-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xt8v\" (UniqueName: \"kubernetes.io/projected/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-kube-api-access-6xt8v\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-daemon-config\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a2b6496-7511-4181-9ab7-f527a0983fb5-agent-certs\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-conf\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.367981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-multus-certs\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.368577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-env-overrides\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be341c-74ff-47cb-b9e8-236f4cf6f96e-tmp-dir\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-cnibin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-sys-fs\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-host-slash\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh46f\" (UniqueName: \"kubernetes.io/projected/8fda7ef2-3b39-40bb-b32e-157d20e52504-kube-api-access-kh46f\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-systemd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-sys\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.369086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.368406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmp7\" (UniqueName: \"kubernetes.io/projected/6460d810-7ac0-4a30-81c0-3bc4f4454707-kube-api-access-sbmp7\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.376595 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.376574 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 09:32:42.379583 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.379565 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmp7\" (UniqueName: \"kubernetes.io/projected/6460d810-7ac0-4a30-81c0-3bc4f4454707-kube-api-access-sbmp7\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.469302 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-system-cni-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.469302 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00be341c-74ff-47cb-b9e8-236f4cf6f96e-hosts-file\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.469302 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-hostroot\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-var-lib-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469342 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-system-cni-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-iptables-alerter-script\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-run\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-hostroot\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z8jd\" (UniqueName: \"kubernetes.io/projected/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-kube-api-access-4z8jd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-var-lib-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-k8s-cni-cncf-io\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00be341c-74ff-47cb-b9e8-236f4cf6f96e-hosts-file\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-run\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-k8s-cni-cncf-io\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.469568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-slash\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-host\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-var-lib-kubelet\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-bin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-slash\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-dbus\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-var-lib-kubelet\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-bin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a2b6496-7511-4181-9ab7-f527a0983fb5-konnectivity-ca\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-systemd-units\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-dbus\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-node-log\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-netd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-system-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-systemd-units\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-etc-kubernetes\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-etc-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-node-log\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-log-socket\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469807 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-host\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469926 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-etc-kubernetes\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kb9\" (UniqueName: \"kubernetes.io/projected/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-kube-api-access-v7kb9\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-netd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-etc-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-system-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.469990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-iptables-alerter-script\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-log-socket\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-host\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-host\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ppp\" (UniqueName: \"kubernetes.io/projected/00be341c-74ff-47cb-b9e8-236f4cf6f96e-kube-api-access-n5ppp\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nw4p\" (UniqueName: \"kubernetes.io/projected/35de1da8-63e8-4820-9632-6b2bcee5378c-kube-api-access-8nw4p\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-netns\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470109 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-bin\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-kubernetes\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.470763 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-registration-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-kubelet\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a2b6496-7511-4181-9ab7-f527a0983fb5-konnectivity-ca\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-cni-binary-copy\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-socket-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-netns\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-cni-bin\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xt8v\" (UniqueName: \"kubernetes.io/projected/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-kube-api-access-6xt8v\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470735 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-daemon-config\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470792 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-registration-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a2b6496-7511-4181-9ab7-f527a0983fb5-agent-certs\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-socket-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470960 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-kubernetes\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.470980 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-kubelet\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.471569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471036 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-cni-binary-copy\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-conf\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-multus-certs\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-env-overrides\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be341c-74ff-47cb-b9e8-236f4cf6f96e-tmp-dir\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-cnibin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-sys-fs\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-host-slash\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh46f\" (UniqueName: \"kubernetes.io/projected/8fda7ef2-3b39-40bb-b32e-157d20e52504-kube-api-access-kh46f\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-systemd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-sys\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.472321 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cnibin\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-cnibin\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-host-slash\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.471954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472007 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysctl-conf\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.472031 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-netns\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn8tn\" (UniqueName: \"kubernetes.io/projected/846c9a35-0f7c-4364-a31b-8b6693865f7d-kube-api-access-pn8tn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysconfig\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.472148 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:42.972114476 +0000 UTC m=+2.119522797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-systemd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be341c-74ff-47cb-b9e8-236f4cf6f96e-tmp-dir\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-sysconfig\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472231 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-openvswitch\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.473451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472267 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-systemd\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472279 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-lib-modules\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-lib-modules\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472437 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-systemd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-multus-certs\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-sys\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-tuned\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-kubelet\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-conf-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472833 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-kubelet\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-kubelet-config\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cnibin\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-script-lib\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472920 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-run-netns\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-sys-fs\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472978 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-env-overrides\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.474212 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-cni-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aad92e5-7b4b-4315-b502-8e651c2ea476-kubelet-config\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-conf-dir\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.472885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473498 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-script-lib\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-serviceca\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-482s5\" (UniqueName: \"kubernetes.io/projected/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-kube-api-access-482s5\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-device-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-ovn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-multus\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-os-release\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473733 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473739 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-os-release\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473810 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-run-ovn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473820 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-host-var-lib-cni-multus\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475021 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-os-release\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-tmp\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-socket-dir-parent\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-config\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovn-node-metrics-cert\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.473987 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-serviceca\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-modprobe-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474196 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-modprobe-d\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/846c9a35-0f7c-4364-a31b-8b6693865f7d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474528 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fda7ef2-3b39-40bb-b32e-157d20e52504-device-dir\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-os-release\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474627 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovnkube-config\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.474665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-socket-dir-parent\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.475856 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.475005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35de1da8-63e8-4820-9632-6b2bcee5378c-multus-daemon-config\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.476497 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.476161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a2b6496-7511-4181-9ab7-f527a0983fb5-agent-certs\") pod \"konnectivity-agent-gjgq6\" (UID: \"1a2b6496-7511-4181-9ab7-f527a0983fb5\") " pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.476905 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.476882 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-etc-tuned\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.477025 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.477009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-tmp\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.477086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.477026 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/846c9a35-0f7c-4364-a31b-8b6693865f7d-ovn-node-metrics-cert\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.480243 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.480222 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z8jd\" (UniqueName: \"kubernetes.io/projected/62b203ac-e7bf-4fb0-a12e-63053a8e31a2-kube-api-access-4z8jd\") pod \"tuned-fqvbz\" (UID: \"62b203ac-e7bf-4fb0-a12e-63053a8e31a2\") " pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.481497 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.481477 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:42.481591 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.481500 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:42.481591 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.481514 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:42.481591 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.481584 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:42.981568464 +0000 UTC m=+2.128976781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:42.481807 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.481762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ppp\" (UniqueName: \"kubernetes.io/projected/00be341c-74ff-47cb-b9e8-236f4cf6f96e-kube-api-access-n5ppp\") pod \"node-resolver-sphx6\" (UID: \"00be341c-74ff-47cb-b9e8-236f4cf6f96e\") " pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.482167 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.482109 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kb9\" (UniqueName: \"kubernetes.io/projected/32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb-kube-api-access-v7kb9\") pod \"iptables-alerter-9p5x2\" (UID: \"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb\") " pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.483012 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.482992 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-482s5\" (UniqueName: \"kubernetes.io/projected/37de4ff9-5de8-43e4-acaa-f29d7d4d8750-kube-api-access-482s5\") pod \"node-ca-4l64c\" (UID: \"37de4ff9-5de8-43e4-acaa-f29d7d4d8750\") " pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.483825 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.483805 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nw4p\" (UniqueName: \"kubernetes.io/projected/35de1da8-63e8-4820-9632-6b2bcee5378c-kube-api-access-8nw4p\") pod \"multus-2lsn5\" (UID: \"35de1da8-63e8-4820-9632-6b2bcee5378c\") " pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.483902 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.483837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xt8v\" (UniqueName: \"kubernetes.io/projected/a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7-kube-api-access-6xt8v\") pod \"multus-additional-cni-plugins-szqfv\" (UID: \"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7\") " pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.484373 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.484356 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh46f\" (UniqueName: \"kubernetes.io/projected/8fda7ef2-3b39-40bb-b32e-157d20e52504-kube-api-access-kh46f\") pod \"aws-ebs-csi-driver-node-t7jtk\" (UID: \"8fda7ef2-3b39-40bb-b32e-157d20e52504\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.484492 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.484477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn8tn\" (UniqueName: \"kubernetes.io/projected/846c9a35-0f7c-4364-a31b-8b6693865f7d-kube-api-access-pn8tn\") pod \"ovnkube-node-k46n4\" (UID: \"846c9a35-0f7c-4364-a31b-8b6693865f7d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.506109 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.506090 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:42.590707 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.590632 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9p5x2" Jun 09 09:32:42.600599 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.600576 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dbf27b_ac0e_4208_b604_5ca2a2c3a7cb.slice/crio-f1698bd84fba6f20c63fb61cd2347aa67b53d75d2b566f87e17855a4ff33ad39 WatchSource:0}: Error finding container f1698bd84fba6f20c63fb61cd2347aa67b53d75d2b566f87e17855a4ff33ad39: Status 404 returned error can't find the container with id f1698bd84fba6f20c63fb61cd2347aa67b53d75d2b566f87e17855a4ff33ad39 Jun 09 09:32:42.606631 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.606614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" Jun 09 09:32:42.613957 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.613936 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b203ac_e7bf_4fb0_a12e_63053a8e31a2.slice/crio-e2f1e1718ba4ad488b9ee00e9c25cb06914ffab66a10ddf15d108648be15ba86 WatchSource:0}: Error finding container e2f1e1718ba4ad488b9ee00e9c25cb06914ffab66a10ddf15d108648be15ba86: Status 404 returned error can't find the container with id e2f1e1718ba4ad488b9ee00e9c25cb06914ffab66a10ddf15d108648be15ba86 Jun 09 09:32:42.619006 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.618990 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:42.627045 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.627023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sphx6" Jun 09 09:32:42.634957 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.634939 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00be341c_74ff_47cb_b9e8_236f4cf6f96e.slice/crio-bdbf984901f9f791b0927a4ecf79cba2f22107ca561b3e2fec04fe870867747c WatchSource:0}: Error finding container bdbf984901f9f791b0927a4ecf79cba2f22107ca561b3e2fec04fe870867747c: Status 404 returned error can't find the container with id bdbf984901f9f791b0927a4ecf79cba2f22107ca561b3e2fec04fe870867747c Jun 09 09:32:42.644384 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.644369 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lsn5" Jun 09 09:32:42.650977 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.650961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-szqfv" Jun 09 09:32:42.651494 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.651477 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35de1da8_63e8_4820_9632_6b2bcee5378c.slice/crio-c0d744270eb4a640979b6ed8c35789ac864eb056520b2491b391c86b435ef6e3 WatchSource:0}: Error finding container c0d744270eb4a640979b6ed8c35789ac864eb056520b2491b391c86b435ef6e3: Status 404 returned error can't find the container with id c0d744270eb4a640979b6ed8c35789ac864eb056520b2491b391c86b435ef6e3 Jun 09 09:32:42.656516 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.656500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:32:42.658113 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.658095 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6055c8f_bfa2_4e2b_a2ef_9e4864e8a6f7.slice/crio-20cf82955df5396c4be58f45b5cff5d1cb3aad928d8aac2b666405780da428a8 WatchSource:0}: Error finding container 20cf82955df5396c4be58f45b5cff5d1cb3aad928d8aac2b666405780da428a8: Status 404 returned error can't find the container with id 20cf82955df5396c4be58f45b5cff5d1cb3aad928d8aac2b666405780da428a8 Jun 09 09:32:42.662110 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.662086 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" Jun 09 09:32:42.664088 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.664064 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2b6496_7511_4181_9ab7_f527a0983fb5.slice/crio-ed4f79def422c1dad0e3702c344ae112d92c0d7acac2d94307c80bd89a562e9d WatchSource:0}: Error finding container ed4f79def422c1dad0e3702c344ae112d92c0d7acac2d94307c80bd89a562e9d: Status 404 returned error can't find the container with id ed4f79def422c1dad0e3702c344ae112d92c0d7acac2d94307c80bd89a562e9d Jun 09 09:32:42.667757 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.667736 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:32:42.670751 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.670729 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fda7ef2_3b39_40bb_b32e_157d20e52504.slice/crio-6c5ed1bd584c2eb67822b61c07f74b81f5b61a7a7f531a2f3442d88d98903c35 WatchSource:0}: Error finding container 6c5ed1bd584c2eb67822b61c07f74b81f5b61a7a7f531a2f3442d88d98903c35: Status 404 returned error can't find the container with id 6c5ed1bd584c2eb67822b61c07f74b81f5b61a7a7f531a2f3442d88d98903c35 Jun 09 09:32:42.672586 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.672568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4l64c" Jun 09 09:32:42.678310 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.678286 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846c9a35_0f7c_4364_a31b_8b6693865f7d.slice/crio-fc36cd4486f0e48891770e7e2a0ec18ef82948c05c04c920fec2b2846988efe3 WatchSource:0}: Error finding container fc36cd4486f0e48891770e7e2a0ec18ef82948c05c04c920fec2b2846988efe3: Status 404 returned error can't find the container with id fc36cd4486f0e48891770e7e2a0ec18ef82948c05c04c920fec2b2846988efe3 Jun 09 09:32:42.682962 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:32:42.682942 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37de4ff9_5de8_43e4_acaa_f29d7d4d8750.slice/crio-f3d72759bbd239bf3cee2d6baee7534d54b9c203544be0b4d12baff4264bc29a WatchSource:0}: Error finding container f3d72759bbd239bf3cee2d6baee7534d54b9c203544be0b4d12baff4264bc29a: Status 404 returned error can't find the container with id f3d72759bbd239bf3cee2d6baee7534d54b9c203544be0b4d12baff4264bc29a Jun 09 09:32:42.877309 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.877207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:42.877519 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.877318 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:42.877519 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.877369 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:43.87735391 +0000 UTC m=+3.024762225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:42.978190 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:42.978066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:42.978358 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.978215 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:42.978358 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:42.978287 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:43.97826461 +0000 UTC m=+3.125672932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:43.062250 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.062205 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:43.079307 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.079274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:43.079468 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.079423 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:43.079468 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.079443 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:43.079468 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.079456 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:43.079624 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.079512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:44.079494013 +0000 UTC m=+3.226902331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:43.307494 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.307381 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:27:42 +0000 UTC" deadline="2028-02-02 22:16:32.716146766 +0000 UTC" Jun 09 09:32:43.307494 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.307447 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14484h43m49.408704333s" Jun 09 09:32:43.360615 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.360493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjgq6" event={"ID":"1a2b6496-7511-4181-9ab7-f527a0983fb5","Type":"ContainerStarted","Data":"ed4f79def422c1dad0e3702c344ae112d92c0d7acac2d94307c80bd89a562e9d"} Jun 09 09:32:43.381369 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.381239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerStarted","Data":"20cf82955df5396c4be58f45b5cff5d1cb3aad928d8aac2b666405780da428a8"} Jun 09 09:32:43.399610 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.399469 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lsn5" event={"ID":"35de1da8-63e8-4820-9632-6b2bcee5378c","Type":"ContainerStarted","Data":"c0d744270eb4a640979b6ed8c35789ac864eb056520b2491b391c86b435ef6e3"} Jun 09 09:32:43.432579 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.432546 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sphx6" event={"ID":"00be341c-74ff-47cb-b9e8-236f4cf6f96e","Type":"ContainerStarted","Data":"bdbf984901f9f791b0927a4ecf79cba2f22107ca561b3e2fec04fe870867747c"} Jun 09 09:32:43.459204 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.459147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" event={"ID":"62b203ac-e7bf-4fb0-a12e-63053a8e31a2","Type":"ContainerStarted","Data":"e2f1e1718ba4ad488b9ee00e9c25cb06914ffab66a10ddf15d108648be15ba86"} Jun 09 09:32:43.471884 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.471720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"fc36cd4486f0e48891770e7e2a0ec18ef82948c05c04c920fec2b2846988efe3"} Jun 09 09:32:43.487243 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.487203 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" event={"ID":"8fda7ef2-3b39-40bb-b32e-157d20e52504","Type":"ContainerStarted","Data":"6c5ed1bd584c2eb67822b61c07f74b81f5b61a7a7f531a2f3442d88d98903c35"} Jun 09 09:32:43.497411 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.497381 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9p5x2" event={"ID":"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb","Type":"ContainerStarted","Data":"f1698bd84fba6f20c63fb61cd2347aa67b53d75d2b566f87e17855a4ff33ad39"} Jun 09 09:32:43.506977 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.506929 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" event={"ID":"627b185f30291ffb2e9813e90451a240","Type":"ContainerStarted","Data":"ba9fb1602a3f9d703420b258a1c3a8102bb1e3d1ebb7d2b3df9bd44ce4064a80"} Jun 09 09:32:43.517319 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.517289 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerStarted","Data":"83940dcd1452f95cce326bdacf6b281496dd81500fa55add893bd4e4d358cac7"} Jun 09 09:32:43.535966 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.535915 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4l64c" event={"ID":"37de4ff9-5de8-43e4-acaa-f29d7d4d8750","Type":"ContainerStarted","Data":"f3d72759bbd239bf3cee2d6baee7534d54b9c203544be0b4d12baff4264bc29a"} Jun 09 09:32:43.886338 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.886304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:43.886946 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.886926 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:43.887055 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.886996 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:45.886975223 +0000 UTC m=+5.034383546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:43.986880 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:43.986846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:43.987103 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.986970 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:43.987103 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:43.987028 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:45.987009599 +0000 UTC m=+5.134417920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:44.089494 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.089460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:44.089669 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.089612 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:44.089669 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.089636 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:44.089669 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.089649 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:44.089817 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.089707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:46.089689114 +0000 UTC m=+5.237097430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:44.308200 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.308058 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:27:42 +0000 UTC" deadline="2027-12-19 17:09:22.660715362 +0000 UTC" Jun 09 09:32:44.308200 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.308092 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13399h36m38.35262694s" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.329531 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.329656 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.330042 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.330145 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:44.330209 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:44.330332 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:44.330291 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:45.336695 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:45.336666 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:32:45.905391 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:45.904811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:45.905391 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:45.904952 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:45.905391 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:45.905016 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:49.904996291 +0000 UTC m=+9.052404904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:46.005637 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:46.005534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:46.005798 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.005697 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:46.005798 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.005771 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:50.005750409 +0000 UTC m=+9.153158729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:46.106358 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:46.106322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:46.106543 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.106483 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:46.106543 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.106504 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:46.106543 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.106516 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:46.106710 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.106576 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:50.106558261 +0000 UTC m=+9.253966602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:46.330029 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:46.329523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:46.330029 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.329641 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:46.330029 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:46.329844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:46.330029 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.329917 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:46.330029 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:46.329979 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:46.330418 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:46.330062 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:48.329617 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:48.329375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:48.330038 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:48.329707 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:48.330038 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:48.329422 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:48.330038 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:48.329808 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:48.330038 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:48.329396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:48.330038 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:48.329901 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:49.937713 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:49.937673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:49.938161 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:49.937844 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:49.938161 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:49.937937 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:57.937915019 +0000 UTC m=+17.085323347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:50.039662 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:50.039070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:50.039662 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.039271 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:50.039662 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.039331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:58.039314127 +0000 UTC m=+17.186722447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:50.139971 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:50.139807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:50.140163 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.139997 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:50.140163 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.140021 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:50.140163 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.140032 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:50.140163 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.140092 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:58.140074654 +0000 UTC m=+17.287482970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:50.330217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:50.329994 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:50.330217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:50.330040 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:50.330217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:50.330139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:50.330217 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.330144 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:50.330507 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.330246 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:50.330507 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:50.330318 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:52.329777 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:52.329683 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:52.329777 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:52.329734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:52.330421 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:52.329818 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:52.330421 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:52.329902 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:52.330421 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:52.329952 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:52.330421 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:52.330028 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:54.329568 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:54.329525 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:54.329981 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:54.329520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:54.329981 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:54.329646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:54.329981 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:54.329637 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:54.329981 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:54.329725 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:54.329981 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:54.329824 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:56.329710 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:56.329679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:56.330159 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:56.329789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:56.330159 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:56.329796 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:56.330159 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:56.329810 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:56.330159 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:56.329916 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:32:56.330159 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:56.329996 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:57.998093 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:57.998061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:57.998480 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:57.998221 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:57.998480 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:57.998284 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:13.99826841 +0000 UTC m=+33.145676729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:32:58.098521 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:58.098494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:58.098645 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.098629 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:58.098699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.098692 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:14.09867514 +0000 UTC m=+33.246083460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:32:58.199480 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:58.199451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:58.199582 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.199568 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:32:58.199582 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.199580 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:32:58.199644 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.199589 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:58.199644 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.199630 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:14.199617638 +0000 UTC m=+33.347025953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:32:58.329225 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:58.329146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:32:58.329381 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:58.329146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:32:58.329381 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.329258 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:32:58.329381 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:32:58.329146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:32:58.329381 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.329341 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:32:58.329559 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:32:58.329422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:00.329589 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:00.329554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:00.330027 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:00.329554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:00.330027 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:00.329679 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:00.330027 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:00.329566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:00.330027 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:00.329760 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:00.330027 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:00.329854 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:02.329417 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:02.329376 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:02.329953 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:02.329376 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:02.329953 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:02.329512 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:02.329953 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:02.329524 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:02.329953 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:02.329603 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:02.329953 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:02.329669 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:03.585939 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.585803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" event={"ID":"627b185f30291ffb2e9813e90451a240","Type":"ContainerStarted","Data":"b1d2f16f58e7736a21e5f019ba16818977e5e83a6664148ccdb89d611c281626"} Jun 09 09:33:03.587347 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.587322 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lsn5" event={"ID":"35de1da8-63e8-4820-9632-6b2bcee5378c","Type":"ContainerStarted","Data":"af844b044f151f04e5c8f9837ff9af21f6e12742f039e8c441d1846028ed3f1f"} Jun 09 09:33:03.589036 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.589007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" event={"ID":"62b203ac-e7bf-4fb0-a12e-63053a8e31a2","Type":"ContainerStarted","Data":"9e7382686348106be504d2a444fb5b2ef84cba9e2fed3cb7c78d0dc0c2305368"} Jun 09 09:33:03.590872 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.590853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:33:03.591263 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.591243 2560 generic.go:356] "Generic (PLEG): container finished" podID="846c9a35-0f7c-4364-a31b-8b6693865f7d" containerID="67f32c5e5c5807e727c9a16a90b7ecb61d6f2a8bc6253b9abd4a975f1c147d9c" exitCode=1 Jun 09 09:33:03.591343 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.591273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerDied","Data":"67f32c5e5c5807e727c9a16a90b7ecb61d6f2a8bc6253b9abd4a975f1c147d9c"} Jun 09 09:33:03.591343 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.591316 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"52fd680ce1169fc3714df240a1b1b0c3eeb39f4e05bb623afb67b733d92c07dc"} Jun 09 09:33:03.600391 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.600351 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" podStartSLOduration=21.600339973 podStartE2EDuration="21.600339973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:03.599793185 +0000 UTC m=+22.747201521" watchObservedRunningTime="2026-06-09 09:33:03.600339973 +0000 UTC m=+22.747748309" Jun 09 09:33:03.619670 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.617444 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fqvbz" podStartSLOduration=2.732360082 podStartE2EDuration="22.617426394s" totalImagesPullingTime="19.885066312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:03.617349191 +0000 UTC m=+22.764757527" watchObservedRunningTime="2026-06-09 09:33:03.617426394 +0000 UTC m=+22.764834732" Jun 09 09:33:03.635559 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:03.635519 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2lsn5" podStartSLOduration=2.783760142 podStartE2EDuration="22.635504201s" totalImagesPullingTime="19.851744059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:03.635004332 +0000 UTC m=+22.782412683" watchObservedRunningTime="2026-06-09 09:33:03.635504201 +0000 UTC m=+22.782912538" Jun 09 09:33:04.329923 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.329698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:04.330087 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.329766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:04.330087 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.329766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:04.330087 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:04.330053 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:04.330225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:04.330098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:04.330225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:04.329940 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:04.594594 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.594567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sphx6" event={"ID":"00be341c-74ff-47cb-b9e8-236f4cf6f96e","Type":"ContainerStarted","Data":"c9fe0d584683a78be681900b68850777ae045ba1dfbefe1ac781969552683883"} Jun 09 09:33:04.597288 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.597269 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:33:04.597645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.597628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"c0302b4c3053fd84f84436cfdd9e3a77a3b0a2e79b4f94715c41a6ecf72074f6"} Jun 09 09:33:04.597710 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.597692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"3da40de744ffe534046604ea197ab60feb9de96cc70da63c3a2dd4d10b904f82"} Jun 09 09:33:04.597759 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.597722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"1ce5531a79f02849d3f1856f6f76f820ea51529e1d4591ca8371e2cb3a40cb46"} Jun 09 09:33:04.597799 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.597757 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"509f2855d4964a04ea79600c71d4bf1712c140d2b143d3db45b477b136f4a51b"} Jun 09 09:33:04.598957 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.598939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" event={"ID":"8fda7ef2-3b39-40bb-b32e-157d20e52504","Type":"ContainerStarted","Data":"79a4ea7d3fc4fedbd84f3064de9f9e0a6456de714f6b424ca3293ec43d285292"} Jun 09 09:33:04.600270 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.600252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9p5x2" event={"ID":"32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb","Type":"ContainerStarted","Data":"05908e0a640c005f8bf70b10aec6805503fcf3f80bb5632047e2e049dd9ed877"} Jun 09 09:33:04.601534 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.601512 2560 generic.go:356] "Generic (PLEG): container finished" podID="3ae446967242a088e635b73955367e69" containerID="bf25f4096a2fbee2d8da2c1d59d9236dd8239e40ea9899864d22c7afa43402cb" exitCode=0 Jun 09 09:33:04.601623 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.601586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerDied","Data":"bf25f4096a2fbee2d8da2c1d59d9236dd8239e40ea9899864d22c7afa43402cb"} Jun 09 09:33:04.602874 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.602857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4l64c" event={"ID":"37de4ff9-5de8-43e4-acaa-f29d7d4d8750","Type":"ContainerStarted","Data":"b9bac655271d59865e0d5cd3d2ab4694d891469f261927291adb78111a641761"} Jun 09 09:33:04.606258 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.606237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjgq6" event={"ID":"1a2b6496-7511-4181-9ab7-f527a0983fb5","Type":"ContainerStarted","Data":"75debe0064e5e81b48180220786c9fc1a70fa352c9bf71248d0751cf9ca84457"} Jun 09 09:33:04.607511 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.607492 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="8465a4109d995b679d9c39c278f767052d634614b266f00a961dd0de59ab16da" exitCode=0 Jun 09 09:33:04.607593 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.607577 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"8465a4109d995b679d9c39c278f767052d634614b266f00a961dd0de59ab16da"} Jun 09 09:33:04.611081 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.611049 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sphx6" podStartSLOduration=3.74276359 podStartE2EDuration="23.611037337s" totalImagesPullingTime="19.868273747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:04.610825264 +0000 UTC m=+23.758233600" watchObservedRunningTime="2026-06-09 09:33:04.611037337 +0000 UTC m=+23.758445675" Jun 09 09:33:04.625060 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.625025 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4l64c" podStartSLOduration=3.811416215 podStartE2EDuration="23.625013498s" totalImagesPullingTime="19.813597283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:04.625001088 +0000 UTC m=+23.772409437" watchObservedRunningTime="2026-06-09 09:33:04.625013498 +0000 UTC m=+23.772421834" Jun 09 09:33:04.641768 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.641729 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9p5x2" podStartSLOduration=3.7746935 podStartE2EDuration="23.641716074s" totalImagesPullingTime="19.867022574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:04.641542837 +0000 UTC m=+23.788951174" watchObservedRunningTime="2026-06-09 09:33:04.641716074 +0000 UTC m=+23.789124410" Jun 09 09:33:04.660896 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.660856 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjgq6" podStartSLOduration=8.141075915 podStartE2EDuration="23.660846208s" totalImagesPullingTime="15.519770293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:04.660825576 +0000 UTC m=+23.808233915" watchObservedRunningTime="2026-06-09 09:33:04.660846208 +0000 UTC m=+23.808254545" Jun 09 09:33:04.705591 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.705560 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:33:04.706081 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:04.706064 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:33:05.121833 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.121813 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 09:33:05.332061 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.331981 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T09:33:05.121829619Z","UUID":"db2aff8f-36b5-487e-8604-74b124106d8e","Handler":null,"Name":"","Endpoint":""} Jun 09 09:33:05.333483 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.333466 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 09:33:05.333565 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.333505 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 09:33:05.611940 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.611903 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerStarted","Data":"6eacf4a13a3cae882aa895a773f694cad8582236066581a5e2e04b847b2f24bf"} Jun 09 09:33:05.614094 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.614045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" event={"ID":"8fda7ef2-3b39-40bb-b32e-157d20e52504","Type":"ContainerStarted","Data":"0b51ea799e59f3980ab7402c22845d668df170e9cdcf418d970113aef0e360c8"} Jun 09 09:33:05.614463 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.614438 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:33:05.614945 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.614928 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjgq6" Jun 09 09:33:05.642187 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:05.642146 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" podStartSLOduration=23.642133619 podStartE2EDuration="23.642133619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:05.6278334 +0000 UTC m=+24.775241736" watchObservedRunningTime="2026-06-09 09:33:05.642133619 +0000 UTC m=+24.789541946" Jun 09 09:33:06.329388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.329316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:06.329736 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.329316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:06.329736 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:06.329422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:06.329736 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:06.329504 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:06.329736 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.329316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:06.329736 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:06.329593 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:06.618999 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.618973 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:33:06.619542 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.619320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"f223fd9805c193d59064d71effc55fe146720006789c5d1d2c43afe42d4bb3ab"} Jun 09 09:33:06.621270 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.621244 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" event={"ID":"8fda7ef2-3b39-40bb-b32e-157d20e52504","Type":"ContainerStarted","Data":"fa29a67ea9ef181c5911397591d6e6a2d0ff55806a032a981d118475bb325cad"} Jun 09 09:33:06.640509 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:06.640470 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7jtk" podStartSLOduration=3.745055952 podStartE2EDuration="25.6404589s" totalImagesPullingTime="21.895402948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:06.640174571 +0000 UTC m=+25.787582908" watchObservedRunningTime="2026-06-09 09:33:06.6404589 +0000 UTC m=+25.787867238" Jun 09 09:33:08.328931 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.328909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:08.329427 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.329004 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:08.329427 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:08.329014 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:08.329427 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:08.329137 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:08.329427 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.329168 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:08.329427 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:08.329284 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:08.629547 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.629385 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:33:08.629956 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.629933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"8554cd13dfabd2fc37c041a40cc61d2a67007c87c65864fc7d6681731495ba72"} Jun 09 09:33:08.630350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.630316 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:08.630421 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.630388 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:08.630506 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.630488 2560 scope.go:117] "RemoveContainer" containerID="67f32c5e5c5807e727c9a16a90b7ecb61d6f2a8bc6253b9abd4a975f1c147d9c" Jun 09 09:33:08.647315 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:08.647296 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:09.638182 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:09.638150 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:33:09.638676 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:09.638627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" event={"ID":"846c9a35-0f7c-4364-a31b-8b6693865f7d","Type":"ContainerStarted","Data":"5e93f811185e5c882d52ac80eb26290355073c48f90540b7d7b6b3f0bd1b21eb"} Jun 09 09:33:09.639254 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:09.639158 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:09.670686 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:09.670419 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" podStartSLOduration=8.141249895 podStartE2EDuration="28.670396837s" totalImagesPullingTime="20.529146942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:09.668630955 +0000 UTC m=+28.816039318" watchObservedRunningTime="2026-06-09 09:33:09.670396837 +0000 UTC m=+28.817805174" Jun 09 09:33:09.671645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:09.671619 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:10.329697 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.329663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:10.329843 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.329701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:10.329843 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.329673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:10.329843 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.329798 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:10.329961 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.329865 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:10.329961 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.329915 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:10.563561 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.563532 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kcphz"] Jun 09 09:33:10.566595 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.566569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm8lp"] Jun 09 09:33:10.569295 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.569276 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7zbbc"] Jun 09 09:33:10.640355 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.640328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:10.640776 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.640328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:10.640776 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.640440 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:10.640776 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.640519 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:10.640776 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:10.640337 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:10.640993 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:10.640962 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:12.329114 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:12.329080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:12.329539 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:12.329194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:12.329539 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:12.329201 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:12.329539 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:12.329230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:12.329539 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:12.329331 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:12.329539 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:12.329429 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:14.018877 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.018845 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:14.019265 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.018976 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:14.019265 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.019027 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:46.019013407 +0000 UTC m=+65.166421722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:33:14.119663 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.119628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:14.119862 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.119766 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:14.119862 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.119823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret podName:1aad92e5-7b4b-4315-b502-8e651c2ea476 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:46.119809654 +0000 UTC m=+65.267217970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret") pod "global-pull-secret-syncer-kcphz" (UID: "1aad92e5-7b4b-4315-b502-8e651c2ea476") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:33:14.220765 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.220735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:14.220898 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.220887 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:33:14.220931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.220906 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:33:14.220931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.220916 2560 projected.go:196] Error preparing data for projected volume kube-api-access-g5mb4 for pod openshift-network-diagnostics/network-check-target-7zbbc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:14.221005 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.220960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4 podName:ce6cde41-52ed-4521-bd85-43e870a25413 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:46.220948472 +0000 UTC m=+65.368356786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5mb4" (UniqueName: "kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4") pod "network-check-target-7zbbc" (UID: "ce6cde41-52ed-4521-bd85-43e870a25413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:33:14.329684 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.329608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:14.329804 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.329608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:14.329804 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.329714 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:14.329804 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:14.329614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:14.329804 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.329796 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:14.329928 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:14.329861 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:16.330114 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.329889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:16.330544 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.329887 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:16.330544 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.329945 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:16.330544 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:16.330239 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kcphz" podUID="1aad92e5-7b4b-4315-b502-8e651c2ea476" Jun 09 09:33:16.330544 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:16.330331 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:33:16.330544 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:16.330421 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7zbbc" podUID="ce6cde41-52ed-4521-bd85-43e870a25413" Jun 09 09:33:16.704762 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.704731 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeReady" Jun 09 09:33:16.704920 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.704893 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 09:33:16.741979 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.741844 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:33:16.780276 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.780247 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bt472"] Jun 09 09:33:16.780431 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.780374 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.783956 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.783074 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 09:33:16.783956 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.783532 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 09:33:16.783956 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.783790 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 09:33:16.784231 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.784060 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6f9wj\"" Jun 09 09:33:16.788828 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.788793 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 09:33:16.796267 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.796238 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwpn7"] Jun 09 09:33:16.796405 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.796368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bt472" Jun 09 09:33:16.798944 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.798922 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 09:33:16.799105 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.798923 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 09:33:16.799195 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.799115 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\"" Jun 09 09:33:16.814563 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.814536 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:33:16.814704 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.814580 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bt472"] Jun 09 09:33:16.814704 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.814608 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwpn7"] Jun 09 09:33:16.814704 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.814679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:16.816995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.816972 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kgzwn\"" Jun 09 09:33:16.817227 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.817214 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 09:33:16.817352 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.817333 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 09:33:16.817441 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.817358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 09:33:16.895315 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.895274 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjgq6_1a2b6496-7511-4181-9ab7-f527a0983fb5/konnectivity-agent/0.log" limit=1024 Jun 09 09:33:16.942392 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fbdf18c-f6ac-49fc-98a5-37dd04889610-config-volume\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:16.942629 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:16.942629 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942629 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942494 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-958z8\" (UniqueName: \"kubernetes.io/projected/cd27a57a-af22-46b1-ab35-f58c1aced8fe-kube-api-access-958z8\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:16.942629 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpjr\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9996\" (UniqueName: \"kubernetes.io/projected/6fbdf18c-f6ac-49fc-98a5-37dd04889610-kube-api-access-b9996\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd27a57a-af22-46b1-ab35-f58c1aced8fe-cert\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.942845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdf18c-f6ac-49fc-98a5-37dd04889610-tmp-dir\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:16.943115 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.943115 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.942909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:16.983106 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:16.982991 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjgq6_1a2b6496-7511-4181-9ab7-f527a0983fb5/konnectivity-agent/0.log" limit=1024 Jun 09 09:33:17.043894 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.043853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044080 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.043902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-958z8\" (UniqueName: \"kubernetes.io/projected/cd27a57a-af22-46b1-ab35-f58c1aced8fe-kube-api-access-958z8\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:17.044080 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.043933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044080 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.044033 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:17.044080 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.044047 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:17.044305 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.044107 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:17.544084618 +0000 UTC m=+36.691492938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:17.044369 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpjr\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044369 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9996\" (UniqueName: \"kubernetes.io/projected/6fbdf18c-f6ac-49fc-98a5-37dd04889610-kube-api-access-b9996\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.044469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd27a57a-af22-46b1-ab35-f58c1aced8fe-cert\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:17.044469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdf18c-f6ac-49fc-98a5-37dd04889610-tmp-dir\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.044645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.044645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.044808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fbdf18c-f6ac-49fc-98a5-37dd04889610-config-volume\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.045161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdf18c-f6ac-49fc-98a5-37dd04889610-tmp-dir\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.045205 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.045304 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.045356 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:17.545342443 +0000 UTC m=+36.692750773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:17.045538 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.045422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.045867 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.045798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.046233 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.046209 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.046324 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.046297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fbdf18c-f6ac-49fc-98a5-37dd04889610-config-volume\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.048727 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.048703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.048812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.048710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd27a57a-af22-46b1-ab35-f58c1aced8fe-cert\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:17.049025 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.049005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.054024 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.053964 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.054024 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.053991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9996\" (UniqueName: \"kubernetes.io/projected/6fbdf18c-f6ac-49fc-98a5-37dd04889610-kube-api-access-b9996\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.054222 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.054064 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-958z8\" (UniqueName: \"kubernetes.io/projected/cd27a57a-af22-46b1-ab35-f58c1aced8fe-kube-api-access-958z8\") pod \"ingress-canary-vwpn7\" (UID: \"cd27a57a-af22-46b1-ab35-f58c1aced8fe\") " pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:17.054929 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.054900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpjr\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.124043 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.124005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwpn7" Jun 09 09:33:17.549521 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.549484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:17.549521 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.549529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:17.550225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.549638 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:17.550225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.549643 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:17.550225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.549717 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:18.549700079 +0000 UTC m=+37.697108397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:17.550225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.549652 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:17.550225 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:17.549785 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:18.549770118 +0000 UTC m=+37.697178439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:17.918394 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:17.918360 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwpn7"] Jun 09 09:33:18.015162 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:33:18.015095 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd27a57a_af22_46b1_ab35_f58c1aced8fe.slice/crio-d71f5af4922f52e3e881d3a52572133f5c24434118989519e5bf81cb21b4577a WatchSource:0}: Error finding container d71f5af4922f52e3e881d3a52572133f5c24434118989519e5bf81cb21b4577a: Status 404 returned error can't find the container with id d71f5af4922f52e3e881d3a52572133f5c24434118989519e5bf81cb21b4577a Jun 09 09:33:18.329216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.329017 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:18.329327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.329022 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:18.329472 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.329066 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:18.333080 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333047 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:33:18.333216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:33:18.333395 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333374 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\"" Jun 09 09:33:18.333494 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333377 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\"" Jun 09 09:33:18.333494 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333432 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:33:18.333595 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.333435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:33:18.559132 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.559081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.559156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:18.559302 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:18.559369 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:18.559383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:20.559358976 +0000 UTC m=+39.706767309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:18.559385 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:18.559773 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:18.559436 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:20.55942091 +0000 UTC m=+39.706829243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:18.659195 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.659151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwpn7" event={"ID":"cd27a57a-af22-46b1-ab35-f58c1aced8fe","Type":"ContainerStarted","Data":"d71f5af4922f52e3e881d3a52572133f5c24434118989519e5bf81cb21b4577a"} Jun 09 09:33:18.661134 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.661091 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="37410ab17fb3803d5232b6f57ec06c9f1a7eac1e1eb1d3fd53cd42ee9f2cc891" exitCode=0 Jun 09 09:33:18.661242 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:18.661151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"37410ab17fb3803d5232b6f57ec06c9f1a7eac1e1eb1d3fd53cd42ee9f2cc891"} Jun 09 09:33:20.578091 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:20.578060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:20.578105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:20.578245 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:20.578247 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:20.578323 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:24.578301577 +0000 UTC m=+43.725709905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:20.578256 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:20.578570 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:20.578389 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:24.578375469 +0000 UTC m=+43.725783803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:20.667297 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:20.667220 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="576abdbff1aedc74255705af2e23a68b7025efba45e6018c52bd2cf30875608e" exitCode=0 Jun 09 09:33:20.667297 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:20.667262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"576abdbff1aedc74255705af2e23a68b7025efba45e6018c52bd2cf30875608e"} Jun 09 09:33:21.671204 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:21.671162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwpn7" event={"ID":"cd27a57a-af22-46b1-ab35-f58c1aced8fe","Type":"ContainerStarted","Data":"eed7b17fc7655d8f89c0e3a4e8f1e02046dc5fc8ea916c7af68d84ad48ff1b06"} Jun 09 09:33:21.687487 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:21.687437 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwpn7" podStartSLOduration=2.94609617 podStartE2EDuration="5.687423051s" totalImagesPullingTime="2.741326881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:21.686901929 +0000 UTC m=+40.834310266" watchObservedRunningTime="2026-06-09 09:33:21.687423051 +0000 UTC m=+40.834831367" Jun 09 09:33:22.675977 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:22.675941 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="cabc4d06bca912047ab0adfe15953c0b8781dd5340edc1eb3588cdff806cfe34" exitCode=0 Jun 09 09:33:22.676416 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:22.676024 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"cabc4d06bca912047ab0adfe15953c0b8781dd5340edc1eb3588cdff806cfe34"} Jun 09 09:33:24.609473 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:24.609426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:24.609492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:24.609590 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:24.609621 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:24.609642 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:24.609655 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:32.609634455 +0000 UTC m=+51.757042770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:24.609931 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:24.609711 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:32.60969223 +0000 UTC m=+51.757100565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:27.692398 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:27.692363 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="8d7bfe665eb51b4f8699eb5e9c45cd629e774957122a00afec020f6a05dc18bd" exitCode=0 Jun 09 09:33:27.692773 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:27.692409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"8d7bfe665eb51b4f8699eb5e9c45cd629e774957122a00afec020f6a05dc18bd"} Jun 09 09:33:28.698095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:28.698064 2560 generic.go:356] "Generic (PLEG): container finished" podID="a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7" containerID="e3cd5f1f7689b0156f3c1241128a7d64b98b954da629a48c3559cef0b23de3c0" exitCode=0 Jun 09 09:33:28.698493 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:28.698107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerDied","Data":"e3cd5f1f7689b0156f3c1241128a7d64b98b954da629a48c3559cef0b23de3c0"} Jun 09 09:33:29.703914 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:29.703875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szqfv" event={"ID":"a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7","Type":"ContainerStarted","Data":"2908497f4301b5404122d164276575f1906eff730ed61c017871b7ff36c37875"} Jun 09 09:33:29.731920 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:29.731873 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-szqfv" podStartSLOduration=8.965870737 podStartE2EDuration="48.731857149s" totalImagesPullingTime="39.765986412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:29.731200218 +0000 UTC m=+48.878608574" watchObservedRunningTime="2026-06-09 09:33:29.731857149 +0000 UTC m=+48.879265486" Jun 09 09:33:32.669009 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:32.668966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:32.669009 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:32.669014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:32.669515 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:32.669111 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:32.669515 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:32.669141 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:32.669515 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:32.669153 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:32.669515 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:32.669189 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:48.669173405 +0000 UTC m=+67.816581723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:32.669515 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:32.669203 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:33:48.669197306 +0000 UTC m=+67.816605621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:41.653451 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:41.653424 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k46n4" Jun 09 09:33:46.071000 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.070955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:33:46.074318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.074299 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:33:46.082111 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:46.082075 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:33:46.082233 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:46.082190 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:50.082166318 +0000 UTC m=+129.229574634 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : secret "metrics-daemon-secret" not found Jun 09 09:33:46.171343 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.171305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:46.174218 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.174201 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:33:46.184934 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.184911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aad92e5-7b4b-4315-b502-8e651c2ea476-original-pull-secret\") pod \"global-pull-secret-syncer-kcphz\" (UID: \"1aad92e5-7b4b-4315-b502-8e651c2ea476\") " pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:46.246729 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.246692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kcphz" Jun 09 09:33:46.272217 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.272182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:46.275342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.275318 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:33:46.285883 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.285851 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:33:46.297549 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.297519 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mb4\" (UniqueName: \"kubernetes.io/projected/ce6cde41-52ed-4521-bd85-43e870a25413-kube-api-access-g5mb4\") pod \"network-check-target-7zbbc\" (UID: \"ce6cde41-52ed-4521-bd85-43e870a25413\") " pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:46.382198 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.382165 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kcphz"] Jun 09 09:33:46.386113 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:33:46.386089 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aad92e5_7b4b_4315_b502_8e651c2ea476.slice/crio-73ffee65b0f314be2ad979a27eacad8a99ce5954a6b8cc5cbd4acea68fea0165 WatchSource:0}: Error finding container 73ffee65b0f314be2ad979a27eacad8a99ce5954a6b8cc5cbd4acea68fea0165: Status 404 returned error can't find the container with id 73ffee65b0f314be2ad979a27eacad8a99ce5954a6b8cc5cbd4acea68fea0165 Jun 09 09:33:46.554157 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.554106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\"" Jun 09 09:33:46.562335 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.562317 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:46.681678 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.681643 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7zbbc"] Jun 09 09:33:46.684665 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:33:46.684636 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6cde41_52ed_4521_bd85_43e870a25413.slice/crio-e23b1225f80847cb8de7d96fa7b245d898fcc5f03a08c085518aa051b0f6a873 WatchSource:0}: Error finding container e23b1225f80847cb8de7d96fa7b245d898fcc5f03a08c085518aa051b0f6a873: Status 404 returned error can't find the container with id e23b1225f80847cb8de7d96fa7b245d898fcc5f03a08c085518aa051b0f6a873 Jun 09 09:33:46.741400 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.741371 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7zbbc" event={"ID":"ce6cde41-52ed-4521-bd85-43e870a25413","Type":"ContainerStarted","Data":"e23b1225f80847cb8de7d96fa7b245d898fcc5f03a08c085518aa051b0f6a873"} Jun 09 09:33:46.742412 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:46.742390 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kcphz" event={"ID":"1aad92e5-7b4b-4315-b502-8e651c2ea476","Type":"ContainerStarted","Data":"73ffee65b0f314be2ad979a27eacad8a99ce5954a6b8cc5cbd4acea68fea0165"} Jun 09 09:33:48.693698 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:48.693666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:48.693726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:48.693847 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:48.693884 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:48.693898 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:48.693924 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:20.693900926 +0000 UTC m=+99.841309245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:33:48.694179 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:33:48.693945 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:34:20.693934408 +0000 UTC m=+99.841342723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:33:51.758510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:51.758478 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kcphz" event={"ID":"1aad92e5-7b4b-4315-b502-8e651c2ea476","Type":"ContainerStarted","Data":"64d9195c3038b5d0681bffceda08d462298e567286d5837abf4400cee1263236"} Jun 09 09:33:51.759911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:51.759889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7zbbc" event={"ID":"ce6cde41-52ed-4521-bd85-43e870a25413","Type":"ContainerStarted","Data":"4facc5db7aba037d0076472f7d904da39c507e5548a5fcdde1ef478047a11958"} Jun 09 09:33:51.760039 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:51.760011 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:33:51.774290 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:51.774246 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kcphz" podStartSLOduration=65.85480522 podStartE2EDuration="1m10.774234055s" totalImagesPullingTime="4.919428835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:51.773589613 +0000 UTC m=+70.920997950" watchObservedRunningTime="2026-06-09 09:33:51.774234055 +0000 UTC m=+70.921642393" Jun 09 09:33:51.788680 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:33:51.788638 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7zbbc" podStartSLOduration=66.179965895 podStartE2EDuration="1m10.788625389s" totalImagesPullingTime="4.608659494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:51.788155573 +0000 UTC m=+70.935563912" watchObservedRunningTime="2026-06-09 09:33:51.788625389 +0000 UTC m=+70.936033726" Jun 09 09:34:20.718692 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:34:20.718642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:34:20.718692 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:34:20.718696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:34:20.719216 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:20.718784 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:34:20.719216 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:20.718788 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:34:20.719216 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:20.718851 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:35:24.718835315 +0000 UTC m=+163.866243631 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:34:20.719216 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:20.718795 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:34:20.719216 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:20.718915 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:35:24.718904101 +0000 UTC m=+163.866312417 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:34:22.765731 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:34:22.765692 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7zbbc" Jun 09 09:34:50.111850 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:34:50.111816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:34:50.112344 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:50.111964 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:34:50.112344 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:34:50.112037 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs podName:6460d810-7ac0-4a30-81c0-3bc4f4454707 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:52.112022399 +0000 UTC m=+251.259430714 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs") pod "network-metrics-daemon-rm8lp" (UID: "6460d810-7ac0-4a30-81c0-3bc4f4454707") : secret "metrics-daemon-secret" not found Jun 09 09:35:19.795586 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:19.795537 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" Jun 09 09:35:19.806076 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:19.806054 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bt472" podUID="6fbdf18c-f6ac-49fc-98a5-37dd04889610" Jun 09 09:35:19.962783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:35:19.962761 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:35:19.962899 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:35:19.962760 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bt472" Jun 09 09:35:21.340453 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:21.340415 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rm8lp" podUID="6460d810-7ac0-4a30-81c0-3bc4f4454707" Jun 09 09:35:24.759960 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:35:24.759898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:35:24.759960 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:35:24.759970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:35:24.760412 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:24.760047 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:35:24.760412 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:24.760055 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 09:35:24.760412 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:24.760075 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795c9768c6-fb57g: secret "image-registry-tls" not found Jun 09 09:35:24.760412 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:24.760110 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls podName:6fbdf18c-f6ac-49fc-98a5-37dd04889610 nodeName:}" failed. No retries permitted until 2026-06-09 09:37:26.760093498 +0000 UTC m=+285.907501812 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls") pod "dns-default-bt472" (UID: "6fbdf18c-f6ac-49fc-98a5-37dd04889610") : secret "dns-default-metrics-tls" not found Jun 09 09:35:24.760412 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:35:24.760150 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls podName:76e29533-0e13-4e86-acb2-7ebaa409204b nodeName:}" failed. No retries permitted until 2026-06-09 09:37:26.76011603 +0000 UTC m=+285.907524345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls") pod "image-registry-795c9768c6-fb57g" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b") : secret "image-registry-tls" not found Jun 09 09:35:33.330024 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:35:33.329943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:36:16.706043 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.706010 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz"] Jun 09 09:36:16.708788 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.708772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" Jun 09 09:36:16.711786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.711766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gqkh2\"" Jun 09 09:36:16.717196 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.717174 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr"] Jun 09 09:36:16.719739 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.719717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l2z7\" (UniqueName: \"kubernetes.io/projected/09e825a1-c29b-4ae3-8ef3-db02093e52c5-kube-api-access-6l2z7\") pod \"network-check-source-dbd9cf844-brxsz\" (UID: \"09e825a1-c29b-4ae3-8ef3-db02093e52c5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" Jun 09 09:36:16.719982 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.719965 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z"] Jun 09 09:36:16.720087 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.720072 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.722617 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.722599 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r"] Jun 09 09:36:16.722713 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.722698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.723344 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.723328 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 09:36:16.723434 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.723328 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 09:36:16.725066 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725048 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 09:36:16.725165 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725065 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 09:36:16.725165 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725111 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 09:36:16.725165 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725068 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nsknj\"" Jun 09 09:36:16.725165 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.725381 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725237 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 09:36:16.725567 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.725549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4szrl\"" Jun 09 09:36:16.728235 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.728205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:36:16.728326 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.728302 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-spg8b\"" Jun 09 09:36:16.728391 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.728331 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 09:36:16.728597 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.728581 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 09:36:16.729727 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.729707 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz"] Jun 09 09:36:16.732103 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.732072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr"] Jun 09 09:36:16.734320 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.734300 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z"] Jun 09 09:36:16.738085 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.738038 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r"] Jun 09 09:36:16.795803 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.795773 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8"] Jun 09 09:36:16.798615 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.798598 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.801046 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.801028 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bj2ch\"" Jun 09 09:36:16.801282 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.801258 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 09:36:16.801366 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.801261 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:36:16.801433 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.801397 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 09:36:16.801479 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.801460 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 09:36:16.803593 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.803575 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67d79d5f85-q6wwq"] Jun 09 09:36:16.806408 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.806389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.809990 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.809955 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 09:36:16.810095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810009 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 09:36:16.810095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810020 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 09:36:16.810095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 09:36:16.810308 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810197 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 09:36:16.810308 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810295 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wwn4k\"" Jun 09 09:36:16.810424 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810291 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 09:36:16.810754 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.810738 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8"] Jun 09 09:36:16.821085 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.821206 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4d6x\" (UniqueName: \"kubernetes.io/projected/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-kube-api-access-r4d6x\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.821206 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctn5p\" (UniqueName: \"kubernetes.io/projected/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-kube-api-access-ctn5p\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.821206 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l2z7\" (UniqueName: \"kubernetes.io/projected/09e825a1-c29b-4ae3-8ef3-db02093e52c5-kube-api-access-6l2z7\") pod \"network-check-source-dbd9cf844-brxsz\" (UID: \"09e825a1-c29b-4ae3-8ef3-db02093e52c5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" Jun 09 09:36:16.821383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.821383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.821383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-default-certificate\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.821383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-config\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.821383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.821645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-stats-auth\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.821645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.821645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8nm\" (UniqueName: \"kubernetes.io/projected/dd769466-da09-499b-9070-a7a34a256a17-kube-api-access-7d8nm\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.821645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/401612eb-dbec-40f3-8b8c-dc58da5afbb8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.821824 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821653 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.821824 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.821824 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.821752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhbsd\" (UniqueName: \"kubernetes.io/projected/b0acb041-2548-4743-912b-8226513f46ad-kube-api-access-xhbsd\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.824116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.824097 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67d79d5f85-q6wwq"] Jun 09 09:36:16.835825 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.835807 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l2z7\" (UniqueName: \"kubernetes.io/projected/09e825a1-c29b-4ae3-8ef3-db02093e52c5-kube-api-access-6l2z7\") pod \"network-check-source-dbd9cf844-brxsz\" (UID: \"09e825a1-c29b-4ae3-8ef3-db02093e52c5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" Jun 09 09:36:16.922815 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.922995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8nm\" (UniqueName: \"kubernetes.io/projected/dd769466-da09-499b-9070-a7a34a256a17-kube-api-access-7d8nm\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.922995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/401612eb-dbec-40f3-8b8c-dc58da5afbb8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.922995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.922995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.922995 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.922983 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.922989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhbsd\" (UniqueName: \"kubernetes.io/projected/b0acb041-2548-4743-912b-8226513f46ad-kube-api-access-xhbsd\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923056 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.42303478 +0000 UTC m=+216.570443098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : secret "router-metrics-certs-default" not found Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923110 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923172 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls podName:49485b71-8cf3-4e5b-a1d4-3ab112cbe341 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.423158717 +0000 UTC m=+216.570567045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zrzwr" (UID: "49485b71-8cf3-4e5b-a1d4-3ab112cbe341") : secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4d6x\" (UniqueName: \"kubernetes.io/projected/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-kube-api-access-r4d6x\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctn5p\" (UniqueName: \"kubernetes.io/projected/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-kube-api-access-ctn5p\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.923303 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-default-certificate\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-config\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-stats-auth\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923424 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923458 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.423444895 +0000 UTC m=+216.570853230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : configmap references non-existent config key: service-ca.crt Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923478 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls podName:dd769466-da09-499b-9070-a7a34a256a17 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.423468743 +0000 UTC m=+216.570877071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-5c47z" (UID: "dd769466-da09-499b-9070-a7a34a256a17") : secret "samples-operator-tls" not found Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923631 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:16.923691 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert podName:401612eb-dbec-40f3-8b8c-dc58da5afbb8 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.423675507 +0000 UTC m=+216.571083824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5fw4r" (UID: "401612eb-dbec-40f3-8b8c-dc58da5afbb8") : secret "networking-console-plugin-cert" not found Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923743 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/401612eb-dbec-40f3-8b8c-dc58da5afbb8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:16.923806 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923743 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.924294 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.923983 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-config\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.925418 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.925397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:16.925845 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.925824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-default-certificate\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.925905 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.925829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-stats-auth\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.932738 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.932712 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8nm\" (UniqueName: \"kubernetes.io/projected/dd769466-da09-499b-9070-a7a34a256a17-kube-api-access-7d8nm\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:16.933541 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.933522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhbsd\" (UniqueName: \"kubernetes.io/projected/b0acb041-2548-4743-912b-8226513f46ad-kube-api-access-xhbsd\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:16.933626 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.933578 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctn5p\" (UniqueName: \"kubernetes.io/projected/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-kube-api-access-ctn5p\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:16.933699 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:16.933682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4d6x\" (UniqueName: \"kubernetes.io/projected/89a5d80b-5212-49e3-92b8-af5bdf33b9e1-kube-api-access-r4d6x\") pod \"service-ca-operator-6bc5ff68f5-xgcw8\" (UID: \"89a5d80b-5212-49e3-92b8-af5bdf33b9e1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:17.017499 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.017429 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" Jun 09 09:36:17.107323 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.107289 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" Jun 09 09:36:17.136594 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.136567 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz"] Jun 09 09:36:17.140094 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:17.140069 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e825a1_c29b_4ae3_8ef3_db02093e52c5.slice/crio-17b0457b896f1b4554e4fd8deebf51286830faa0e4a2ac9619b6e16188d13c06 WatchSource:0}: Error finding container 17b0457b896f1b4554e4fd8deebf51286830faa0e4a2ac9619b6e16188d13c06: Status 404 returned error can't find the container with id 17b0457b896f1b4554e4fd8deebf51286830faa0e4a2ac9619b6e16188d13c06 Jun 09 09:36:17.230452 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.230426 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8"] Jun 09 09:36:17.233548 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:17.233523 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a5d80b_5212_49e3_92b8_af5bdf33b9e1.slice/crio-737003fc60789ae21263bd9c8b21e0ccf4189e877835fa388d78d35bd90ee3dd WatchSource:0}: Error finding container 737003fc60789ae21263bd9c8b21e0ccf4189e877835fa388d78d35bd90ee3dd: Status 404 returned error can't find the container with id 737003fc60789ae21263bd9c8b21e0ccf4189e877835fa388d78d35bd90ee3dd Jun 09 09:36:17.426467 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.426432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:17.426652 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.426481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:17.426652 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.426516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:17.426652 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.426559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:17.426652 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426620 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.426600266 +0000 UTC m=+217.574008582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : configmap references non-existent config key: service-ca.crt Jun 09 09:36:17.426844 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:17.426662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:17.426844 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426670 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 09:36:17.426844 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426670 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 09:36:17.426844 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426673 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 09:36:17.426844 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426718 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:17.426985 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426752 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.426740992 +0000 UTC m=+217.574149307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : secret "router-metrics-certs-default" not found Jun 09 09:36:17.426985 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426871 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert podName:401612eb-dbec-40f3-8b8c-dc58da5afbb8 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.426858702 +0000 UTC m=+217.574267021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5fw4r" (UID: "401612eb-dbec-40f3-8b8c-dc58da5afbb8") : secret "networking-console-plugin-cert" not found Jun 09 09:36:17.426985 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426883 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls podName:dd769466-da09-499b-9070-a7a34a256a17 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.4268769 +0000 UTC m=+217.574285215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-5c47z" (UID: "dd769466-da09-499b-9070-a7a34a256a17") : secret "samples-operator-tls" not found Jun 09 09:36:17.426985 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:17.426893 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls podName:49485b71-8cf3-4e5b-a1d4-3ab112cbe341 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.426888608 +0000 UTC m=+217.574296922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zrzwr" (UID: "49485b71-8cf3-4e5b-a1d4-3ab112cbe341") : secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:18.099569 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.099533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" event={"ID":"09e825a1-c29b-4ae3-8ef3-db02093e52c5","Type":"ContainerStarted","Data":"ddd00840cbeffa3f2cdce296077a9235b833da4c5fe6c1ca953c7aa1d7acde52"} Jun 09 09:36:18.100050 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.099592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" event={"ID":"09e825a1-c29b-4ae3-8ef3-db02093e52c5","Type":"ContainerStarted","Data":"17b0457b896f1b4554e4fd8deebf51286830faa0e4a2ac9619b6e16188d13c06"} Jun 09 09:36:18.101184 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.101150 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" event={"ID":"89a5d80b-5212-49e3-92b8-af5bdf33b9e1","Type":"ContainerStarted","Data":"737003fc60789ae21263bd9c8b21e0ccf4189e877835fa388d78d35bd90ee3dd"} Jun 09 09:36:18.115784 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.115730 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-brxsz" podStartSLOduration=2.115712672 podStartE2EDuration="2.115712672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:18.114852159 +0000 UTC m=+217.262260497" watchObservedRunningTime="2026-06-09 09:36:18.115712672 +0000 UTC m=+217.263121010" Jun 09 09:36:18.435383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.435295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:18.435520 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435464 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:18.435520 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.435478 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:18.435520 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.435512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:18.435667 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435526 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls podName:49485b71-8cf3-4e5b-a1d4-3ab112cbe341 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.435509277 +0000 UTC m=+219.582917592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zrzwr" (UID: "49485b71-8cf3-4e5b-a1d4-3ab112cbe341") : secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:18.435667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.435565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:18.435667 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435601 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 09:36:18.435667 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:18.435619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:18.435667 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435653 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 09:36:18.435867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435656 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.435636719 +0000 UTC m=+219.583045045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : configmap references non-existent config key: service-ca.crt Jun 09 09:36:18.435867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435718 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls podName:dd769466-da09-499b-9070-a7a34a256a17 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.435703424 +0000 UTC m=+219.583111756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-5c47z" (UID: "dd769466-da09-499b-9070-a7a34a256a17") : secret "samples-operator-tls" not found Jun 09 09:36:18.435867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435717 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 09:36:18.435867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435733 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert podName:401612eb-dbec-40f3-8b8c-dc58da5afbb8 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.435724414 +0000 UTC m=+219.583132733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5fw4r" (UID: "401612eb-dbec-40f3-8b8c-dc58da5afbb8") : secret "networking-console-plugin-cert" not found Jun 09 09:36:18.435867 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:18.435756 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.435744016 +0000 UTC m=+219.583152337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : secret "router-metrics-certs-default" not found Jun 09 09:36:19.106390 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:19.106353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" event={"ID":"89a5d80b-5212-49e3-92b8-af5bdf33b9e1","Type":"ContainerStarted","Data":"dfcbba68959de7edea33de321c6ce50bc4ff4119592e05042e37b0f3bcacd5c6"} Jun 09 09:36:19.123645 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:19.123596 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" podStartSLOduration=1.418454995 podStartE2EDuration="3.123580331s" totalImagesPullingTime="1.705125336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:19.122492779 +0000 UTC m=+218.269901116" watchObservedRunningTime="2026-06-09 09:36:19.123580331 +0000 UTC m=+218.270988667" Jun 09 09:36:20.452547 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:20.452510 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:20.452567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:20.452613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:20.452631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:20.452649 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452696 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452737 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452757 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452768 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.452749786 +0000 UTC m=+223.600158111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : secret "router-metrics-certs-default" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452801 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452808 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.452796119 +0000 UTC m=+223.600204434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : configmap references non-existent config key: service-ca.crt Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls podName:49485b71-8cf3-4e5b-a1d4-3ab112cbe341 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.452813976 +0000 UTC m=+223.600222296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zrzwr" (UID: "49485b71-8cf3-4e5b-a1d4-3ab112cbe341") : secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452838 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls podName:dd769466-da09-499b-9070-a7a34a256a17 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.452830481 +0000 UTC m=+223.600238800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-5c47z" (UID: "dd769466-da09-499b-9070-a7a34a256a17") : secret "samples-operator-tls" not found Jun 09 09:36:20.452992 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:20.452850 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert podName:401612eb-dbec-40f3-8b8c-dc58da5afbb8 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.452845009 +0000 UTC m=+223.600253325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5fw4r" (UID: "401612eb-dbec-40f3-8b8c-dc58da5afbb8") : secret "networking-console-plugin-cert" not found Jun 09 09:36:22.320175 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.320141 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl"] Jun 09 09:36:22.323219 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.323202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" Jun 09 09:36:22.326098 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.326074 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 09:36:22.326224 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.326181 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vrjzs\"" Jun 09 09:36:22.326224 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.326212 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 09:36:22.331062 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.331026 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl"] Jun 09 09:36:22.368312 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.368282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4kj\" (UniqueName: \"kubernetes.io/projected/aeedb5e6-415d-480e-8ebc-ee74dde4d3db-kube-api-access-dv4kj\") pod \"migrator-955ffdf5f-kqzpl\" (UID: \"aeedb5e6-415d-480e-8ebc-ee74dde4d3db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" Jun 09 09:36:22.469047 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.469006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4kj\" (UniqueName: \"kubernetes.io/projected/aeedb5e6-415d-480e-8ebc-ee74dde4d3db-kube-api-access-dv4kj\") pod \"migrator-955ffdf5f-kqzpl\" (UID: \"aeedb5e6-415d-480e-8ebc-ee74dde4d3db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" Jun 09 09:36:22.476835 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.476815 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4kj\" (UniqueName: \"kubernetes.io/projected/aeedb5e6-415d-480e-8ebc-ee74dde4d3db-kube-api-access-dv4kj\") pod \"migrator-955ffdf5f-kqzpl\" (UID: \"aeedb5e6-415d-480e-8ebc-ee74dde4d3db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" Jun 09 09:36:22.632460 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.632428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" Jun 09 09:36:22.751101 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.751070 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl"] Jun 09 09:36:22.755336 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:22.755298 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeedb5e6_415d_480e_8ebc_ee74dde4d3db.slice/crio-c70a63c2416dcb6b1d3d81c049b82a668210d6a6e1e6599926dde3460bd70793 WatchSource:0}: Error finding container c70a63c2416dcb6b1d3d81c049b82a668210d6a6e1e6599926dde3460bd70793: Status 404 returned error can't find the container with id c70a63c2416dcb6b1d3d81c049b82a668210d6a6e1e6599926dde3460bd70793 Jun 09 09:36:22.880505 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.880468 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nb2tz"] Jun 09 09:36:22.884512 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.884456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:22.887374 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.887336 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 09:36:22.887472 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.887342 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 09:36:22.887472 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.887418 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 09:36:22.887472 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.887435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gvptt\"" Jun 09 09:36:22.888248 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.888235 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 09:36:22.890846 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.890827 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nb2tz"] Jun 09 09:36:22.973470 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.973433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1175365-2dcc-4931-87f9-883223eb63e1-signing-cabundle\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:22.973470 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.973475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1175365-2dcc-4931-87f9-883223eb63e1-signing-key\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:22.973665 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:22.973496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkc6t\" (UniqueName: \"kubernetes.io/projected/a1175365-2dcc-4931-87f9-883223eb63e1-kube-api-access-pkc6t\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.074210 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.074174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1175365-2dcc-4931-87f9-883223eb63e1-signing-cabundle\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.074372 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.074215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1175365-2dcc-4931-87f9-883223eb63e1-signing-key\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.074372 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.074241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkc6t\" (UniqueName: \"kubernetes.io/projected/a1175365-2dcc-4931-87f9-883223eb63e1-kube-api-access-pkc6t\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.074820 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.074803 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1175365-2dcc-4931-87f9-883223eb63e1-signing-cabundle\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.076633 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.076616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1175365-2dcc-4931-87f9-883223eb63e1-signing-key\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.082267 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.082248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkc6t\" (UniqueName: \"kubernetes.io/projected/a1175365-2dcc-4931-87f9-883223eb63e1-kube-api-access-pkc6t\") pod \"service-ca-7d74d578b8-nb2tz\" (UID: \"a1175365-2dcc-4931-87f9-883223eb63e1\") " pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.119625 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.119596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" event={"ID":"aeedb5e6-415d-480e-8ebc-ee74dde4d3db","Type":"ContainerStarted","Data":"c70a63c2416dcb6b1d3d81c049b82a668210d6a6e1e6599926dde3460bd70793"} Jun 09 09:36:23.194227 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.194145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" Jun 09 09:36:23.313598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.313563 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nb2tz"] Jun 09 09:36:23.316253 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:23.316088 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1175365_2dcc_4931_87f9_883223eb63e1.slice/crio-8b22e3cfccb82cce0a16bc7c1f546e9c2866610973e2256d53b61804a5965082 WatchSource:0}: Error finding container 8b22e3cfccb82cce0a16bc7c1f546e9c2866610973e2256d53b61804a5965082: Status 404 returned error can't find the container with id 8b22e3cfccb82cce0a16bc7c1f546e9c2866610973e2256d53b61804a5965082 Jun 09 09:36:23.500422 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:23.500350 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sphx6_00be341c-74ff-47cb-b9e8-236f4cf6f96e/dns-node-resolver/0.log" Jun 09 09:36:24.101238 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.101210 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4l64c_37de4ff9-5de8-43e4-acaa-f29d7d4d8750/node-ca/0.log" Jun 09 09:36:24.125959 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.125923 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" event={"ID":"a1175365-2dcc-4931-87f9-883223eb63e1","Type":"ContainerStarted","Data":"877d647e264a0d63a0a5b037543085bf9af0c0b9a1f39894721e425dd8050712"} Jun 09 09:36:24.126141 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.125986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" event={"ID":"a1175365-2dcc-4931-87f9-883223eb63e1","Type":"ContainerStarted","Data":"8b22e3cfccb82cce0a16bc7c1f546e9c2866610973e2256d53b61804a5965082"} Jun 09 09:36:24.145296 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.145250 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-nb2tz" podStartSLOduration=2.145236671 podStartE2EDuration="2.145236671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:24.144503936 +0000 UTC m=+223.291912294" watchObservedRunningTime="2026-06-09 09:36:24.145236671 +0000 UTC m=+223.292645007" Jun 09 09:36:24.486469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.486380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:24.486469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.486422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:24.486469 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.486446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.486483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486545 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486564 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486587 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486550 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.486534178 +0000 UTC m=+231.633942496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : configmap references non-existent config key: service-ca.crt Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:24.486615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486625 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs podName:b0acb041-2548-4743-912b-8226513f46ad nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.486610157 +0000 UTC m=+231.634018475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs") pod "router-default-67d79d5f85-q6wwq" (UID: "b0acb041-2548-4743-912b-8226513f46ad") : secret "router-metrics-certs-default" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486644 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls podName:dd769466-da09-499b-9070-a7a34a256a17 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.486634649 +0000 UTC m=+231.634042971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-5c47z" (UID: "dd769466-da09-499b-9070-a7a34a256a17") : secret "samples-operator-tls" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486651 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:24.486699 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486670 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert podName:401612eb-dbec-40f3-8b8c-dc58da5afbb8 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.486659917 +0000 UTC m=+231.634068238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5fw4r" (UID: "401612eb-dbec-40f3-8b8c-dc58da5afbb8") : secret "networking-console-plugin-cert" not found Jun 09 09:36:24.487004 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:36:24.486713 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls podName:49485b71-8cf3-4e5b-a1d4-3ab112cbe341 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.486678911 +0000 UTC m=+231.634087236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zrzwr" (UID: "49485b71-8cf3-4e5b-a1d4-3ab112cbe341") : secret "cluster-monitoring-operator-tls" not found Jun 09 09:36:25.130711 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:25.130673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" event={"ID":"aeedb5e6-415d-480e-8ebc-ee74dde4d3db","Type":"ContainerStarted","Data":"d9a51bf5887e17f2cba50cc5e32e3ff8d804eaea03be78c7418a014628e48611"} Jun 09 09:36:25.131109 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:25.130729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" event={"ID":"aeedb5e6-415d-480e-8ebc-ee74dde4d3db","Type":"ContainerStarted","Data":"0870dea1c7866413633a4e3ee2fd4a46ae7b4a9da40ea1cfa8e251ee77b14113"} Jun 09 09:36:25.149408 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:25.149360 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kqzpl" podStartSLOduration=1.730678811 podStartE2EDuration="3.149345781s" totalImagesPullingTime="1.41866697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:25.148407754 +0000 UTC m=+224.295816092" watchObservedRunningTime="2026-06-09 09:36:25.149345781 +0000 UTC m=+224.296754117" Jun 09 09:36:25.301211 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:25.301181 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwpn7_cd27a57a-af22-46b1-ab35-f58c1aced8fe/serve-healthcheck-canary/0.log" Jun 09 09:36:32.555874 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.555829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:32.556318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.555901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:32.556318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.555954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:32.556318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.555972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:32.556318 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.556020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:32.557146 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.557094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0acb041-2548-4743-912b-8226513f46ad-service-ca-bundle\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:32.559304 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.559277 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd769466-da09-499b-9070-a7a34a256a17-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-5c47z\" (UID: \"dd769466-da09-499b-9070-a7a34a256a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:32.559459 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.559296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49485b71-8cf3-4e5b-a1d4-3ab112cbe341-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zrzwr\" (UID: \"49485b71-8cf3-4e5b-a1d4-3ab112cbe341\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:32.559676 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.559649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/401612eb-dbec-40f3-8b8c-dc58da5afbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5fw4r\" (UID: \"401612eb-dbec-40f3-8b8c-dc58da5afbb8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:32.562438 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.562418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0acb041-2548-4743-912b-8226513f46ad-metrics-certs\") pod \"router-default-67d79d5f85-q6wwq\" (UID: \"b0acb041-2548-4743-912b-8226513f46ad\") " pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:32.629194 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.629150 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" Jun 09 09:36:32.637276 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.637247 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" Jun 09 09:36:32.643086 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.642905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" Jun 09 09:36:32.714822 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.714785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:32.798985 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.798712 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr"] Jun 09 09:36:32.798985 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:32.798900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49485b71_8cf3_4e5b_a1d4_3ab112cbe341.slice/crio-511e68dd497d7f184380702bf37fd92b32701a8d9a1c2b250adc62d1d080bb5d WatchSource:0}: Error finding container 511e68dd497d7f184380702bf37fd92b32701a8d9a1c2b250adc62d1d080bb5d: Status 404 returned error can't find the container with id 511e68dd497d7f184380702bf37fd92b32701a8d9a1c2b250adc62d1d080bb5d Jun 09 09:36:32.874369 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:32.874343 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67d79d5f85-q6wwq"] Jun 09 09:36:32.876452 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:32.876416 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0acb041_2548_4743_912b_8226513f46ad.slice/crio-c6341e8057d9795cbc5f30e66ba048fd8d11de974d8b5353619c763c597ff10f WatchSource:0}: Error finding container c6341e8057d9795cbc5f30e66ba048fd8d11de974d8b5353619c763c597ff10f: Status 404 returned error can't find the container with id c6341e8057d9795cbc5f30e66ba048fd8d11de974d8b5353619c763c597ff10f Jun 09 09:36:33.028275 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.028231 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r"] Jun 09 09:36:33.030108 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.030083 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z"] Jun 09 09:36:33.033382 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:33.033359 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401612eb_dbec_40f3_8b8c_dc58da5afbb8.slice/crio-a24deb99e4bb69e9fa52109a37f79accd152151e35cbb5e862fd08860f772fd9 WatchSource:0}: Error finding container a24deb99e4bb69e9fa52109a37f79accd152151e35cbb5e862fd08860f772fd9: Status 404 returned error can't find the container with id a24deb99e4bb69e9fa52109a37f79accd152151e35cbb5e862fd08860f772fd9 Jun 09 09:36:33.161426 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.161380 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" event={"ID":"401612eb-dbec-40f3-8b8c-dc58da5afbb8","Type":"ContainerStarted","Data":"a24deb99e4bb69e9fa52109a37f79accd152151e35cbb5e862fd08860f772fd9"} Jun 09 09:36:33.162460 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.162424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" event={"ID":"49485b71-8cf3-4e5b-a1d4-3ab112cbe341","Type":"ContainerStarted","Data":"511e68dd497d7f184380702bf37fd92b32701a8d9a1c2b250adc62d1d080bb5d"} Jun 09 09:36:33.163706 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.163682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" event={"ID":"dd769466-da09-499b-9070-a7a34a256a17","Type":"ContainerStarted","Data":"4a0bde5a0424d949dfc43330c63fa47e39e6c938791c76328c3a4360a91a257d"} Jun 09 09:36:33.165087 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.165067 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" event={"ID":"b0acb041-2548-4743-912b-8226513f46ad","Type":"ContainerStarted","Data":"038316a7747a3c0c1c521115ff85ab974b8babbb16098fb65431a017d5568481"} Jun 09 09:36:33.165184 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.165102 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" event={"ID":"b0acb041-2548-4743-912b-8226513f46ad","Type":"ContainerStarted","Data":"c6341e8057d9795cbc5f30e66ba048fd8d11de974d8b5353619c763c597ff10f"} Jun 09 09:36:33.183249 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.183193 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" podStartSLOduration=17.183177147 podStartE2EDuration="17.183177147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:33.182478118 +0000 UTC m=+232.329886456" watchObservedRunningTime="2026-06-09 09:36:33.183177147 +0000 UTC m=+232.330585483" Jun 09 09:36:33.716193 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.716137 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:33.718932 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:33.718907 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:34.172683 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:34.172650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:34.173980 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:34.173956 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67d79d5f85-q6wwq" Jun 09 09:36:36.180083 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.180047 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" event={"ID":"401612eb-dbec-40f3-8b8c-dc58da5afbb8","Type":"ContainerStarted","Data":"510c41ea8e58cc7e249c727a0774929bdabdcaa9af45658fe5c548f7ffb138ba"} Jun 09 09:36:36.181436 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.181411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" event={"ID":"49485b71-8cf3-4e5b-a1d4-3ab112cbe341","Type":"ContainerStarted","Data":"dd7da71496de87240b4ee9e229fa230b4b4e2e67ca6989b88e08a6c5bc62c7a5"} Jun 09 09:36:36.183110 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.183088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" event={"ID":"dd769466-da09-499b-9070-a7a34a256a17","Type":"ContainerStarted","Data":"af8424320de61196f54fe38a60cce012cfc7c42d15bb80d8644a9829c7298387"} Jun 09 09:36:36.183210 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.183154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" event={"ID":"dd769466-da09-499b-9070-a7a34a256a17","Type":"ContainerStarted","Data":"5695ab1f7d78ebe13347ab60e6d03571573adc8f55a4ee7dcd06efe9c3d025d3"} Jun 09 09:36:36.196789 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.196754 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5fw4r" podStartSLOduration=17.896248375 podStartE2EDuration="20.196741164s" totalImagesPullingTime="2.300492789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:36.195014973 +0000 UTC m=+235.342423311" watchObservedRunningTime="2026-06-09 09:36:36.196741164 +0000 UTC m=+235.344149500" Jun 09 09:36:36.210150 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:36.210089 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zrzwr" podStartSLOduration=17.670869606 podStartE2EDuration="20.21007636s" totalImagesPullingTime="2.539206754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:36.209553274 +0000 UTC m=+235.356961610" watchObservedRunningTime="2026-06-09 09:36:36.21007636 +0000 UTC m=+235.357484718" Jun 09 09:36:42.882464 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.882405 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-5c47z" podStartSLOduration=24.624074115 podStartE2EDuration="26.882384103s" totalImagesPullingTime="2.258309988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:36.226892775 +0000 UTC m=+235.374301129" watchObservedRunningTime="2026-06-09 09:36:42.882384103 +0000 UTC m=+242.029792441" Jun 09 09:36:42.882898 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.882667 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ws9m4"] Jun 09 09:36:42.887322 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.887301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:42.890045 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.890007 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 09:36:42.890242 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.890207 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd4jm\"" Jun 09 09:36:42.890342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.890247 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 09:36:42.890342 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.890272 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 09:36:42.891193 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.891173 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 09:36:42.896140 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.896095 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ws9m4"] Jun 09 09:36:42.940975 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.940938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78c7a09e-e065-4d1a-a73c-62d0142a8627-data-volume\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:42.940975 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.940982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78c7a09e-e065-4d1a-a73c-62d0142a8627-crio-socket\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:42.941224 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.941014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78c7a09e-e065-4d1a-a73c-62d0142a8627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:42.941224 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.941032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qbp4\" (UniqueName: \"kubernetes.io/projected/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-api-access-9qbp4\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:42.941224 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:42.941092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042009 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.041976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78c7a09e-e065-4d1a-a73c-62d0142a8627-data-volume\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78c7a09e-e065-4d1a-a73c-62d0142a8627-crio-socket\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78c7a09e-e065-4d1a-a73c-62d0142a8627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qbp4\" (UniqueName: \"kubernetes.io/projected/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-api-access-9qbp4\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78c7a09e-e065-4d1a-a73c-62d0142a8627-crio-socket\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78c7a09e-e065-4d1a-a73c-62d0142a8627-data-volume\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.042555 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.042537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.044507 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.044487 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78c7a09e-e065-4d1a-a73c-62d0142a8627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.050074 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.050049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qbp4\" (UniqueName: \"kubernetes.io/projected/78c7a09e-e065-4d1a-a73c-62d0142a8627-kube-api-access-9qbp4\") pod \"insights-runtime-extractor-ws9m4\" (UID: \"78c7a09e-e065-4d1a-a73c-62d0142a8627\") " pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.198064 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.197971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ws9m4" Jun 09 09:36:43.325241 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:43.325202 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ws9m4"] Jun 09 09:36:44.211346 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:44.211311 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ws9m4" event={"ID":"78c7a09e-e065-4d1a-a73c-62d0142a8627","Type":"ContainerStarted","Data":"3be162873f4db4501e6c061b2633e944e628a6870bf388497da4d24fe471df5e"} Jun 09 09:36:44.211695 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:44.211371 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ws9m4" event={"ID":"78c7a09e-e065-4d1a-a73c-62d0142a8627","Type":"ContainerStarted","Data":"7dd12b4bf4ef68a69c7b052dc48c4b94407cf29e852ebfede1b2f9337a930940"} Jun 09 09:36:44.211695 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:44.211390 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ws9m4" event={"ID":"78c7a09e-e065-4d1a-a73c-62d0142a8627","Type":"ContainerStarted","Data":"b7f3dc2e50bd0c8b5a8d4f29972ed94f20a0154c7bded54993f02300d40f3d2b"} Jun 09 09:36:45.913439 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.913407 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fgngl"] Jun 09 09:36:45.916518 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.916503 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:45.920407 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.920381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bqhfr\"" Jun 09 09:36:45.920407 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.920401 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 09:36:45.920562 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.920387 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 09:36:45.920562 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.920386 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 09:36:45.927414 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:45.927385 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fgngl"] Jun 09 09:36:46.072261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.072228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.072261 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.072269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.072476 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.072296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.072476 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.072360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t8gs\" (UniqueName: \"kubernetes.io/projected/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-kube-api-access-2t8gs\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.173727 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.173626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t8gs\" (UniqueName: \"kubernetes.io/projected/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-kube-api-access-2t8gs\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.173727 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.173702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.173727 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.173730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.173943 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.173755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.174529 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.174503 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.176175 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.176154 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.176277 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.176258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.181408 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.181383 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t8gs\" (UniqueName: \"kubernetes.io/projected/50313f55-6c0f-4f0f-b93b-a0cdf96b1b04-kube-api-access-2t8gs\") pod \"prometheus-operator-7f7d445d84-fgngl\" (UID: \"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.220891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.220853 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ws9m4" event={"ID":"78c7a09e-e065-4d1a-a73c-62d0142a8627","Type":"ContainerStarted","Data":"76ed2855ad65db6d7fc2ad6da969514ea072bdcce513d36d2210c4144e657d5d"} Jun 09 09:36:46.228391 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.228375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" Jun 09 09:36:46.237811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.237760 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ws9m4" podStartSLOduration=2.175698698 podStartE2EDuration="4.23774114s" totalImagesPullingTime="2.062042442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:46.237480577 +0000 UTC m=+245.384888947" watchObservedRunningTime="2026-06-09 09:36:46.23774114 +0000 UTC m=+245.385149478" Jun 09 09:36:46.351360 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:46.351338 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-fgngl"] Jun 09 09:36:46.353502 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:46.353469 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50313f55_6c0f_4f0f_b93b_a0cdf96b1b04.slice/crio-229bd12f311b1c9ce4bfdd711ad8569e5d4ddd0d9d98281d6dff6e47648b94f9 WatchSource:0}: Error finding container 229bd12f311b1c9ce4bfdd711ad8569e5d4ddd0d9d98281d6dff6e47648b94f9: Status 404 returned error can't find the container with id 229bd12f311b1c9ce4bfdd711ad8569e5d4ddd0d9d98281d6dff6e47648b94f9 Jun 09 09:36:47.224907 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:47.224875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" event={"ID":"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04","Type":"ContainerStarted","Data":"229bd12f311b1c9ce4bfdd711ad8569e5d4ddd0d9d98281d6dff6e47648b94f9"} Jun 09 09:36:48.229390 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:48.229351 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" event={"ID":"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04","Type":"ContainerStarted","Data":"ce5616028258d5de62dd9dfab3838a803d34cd2bf435e52afe632f1330f1b942"} Jun 09 09:36:48.229909 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:48.229406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" event={"ID":"50313f55-6c0f-4f0f-b93b-a0cdf96b1b04","Type":"ContainerStarted","Data":"9c6e9840ab406b24f36d411c920de2d307ac048d1aa023101c68c7d7adf2ffe8"} Jun 09 09:36:48.246399 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:48.246352 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-fgngl" podStartSLOduration=1.9763679079999998 podStartE2EDuration="3.246336634s" totalImagesPullingTime="1.269968726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:48.245249688 +0000 UTC m=+247.392658063" watchObservedRunningTime="2026-06-09 09:36:48.246336634 +0000 UTC m=+247.393745000" Jun 09 09:36:50.286309 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.286273 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rnj7b"] Jun 09 09:36:50.290867 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.290847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.293402 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.293378 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 09:36:50.293402 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.293392 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 09:36:50.293590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.293379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q78cq\"" Jun 09 09:36:50.293590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.293393 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 09:36:50.410970 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.410934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-sys\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-root\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-tls\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-wtmp\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411182 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-textfile\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411403 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411403 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-metrics-client-ca\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.411403 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.411247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcx7z\" (UniqueName: \"kubernetes.io/projected/dae0a142-1767-4ed7-813e-cc7095792527-kube-api-access-xcx7z\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.512767 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-sys\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.512923 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.512923 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-root\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.512923 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512861 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-sys\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.512923 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-tls\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-wtmp\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-root\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-textfile\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.512999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-metrics-client-ca\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcx7z\" (UniqueName: \"kubernetes.io/projected/dae0a142-1767-4ed7-813e-cc7095792527-kube-api-access-xcx7z\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513090 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-wtmp\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513456 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513339 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-textfile\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513883 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.513986 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.513863 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae0a142-1767-4ed7-813e-cc7095792527-metrics-client-ca\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.515465 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.515442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.515557 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.515477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dae0a142-1767-4ed7-813e-cc7095792527-node-exporter-tls\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.520643 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.520609 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcx7z\" (UniqueName: \"kubernetes.io/projected/dae0a142-1767-4ed7-813e-cc7095792527-kube-api-access-xcx7z\") pod \"node-exporter-rnj7b\" (UID: \"dae0a142-1767-4ed7-813e-cc7095792527\") " pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.600436 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:50.600408 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnj7b" Jun 09 09:36:50.615884 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:50.615857 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae0a142_1767_4ed7_813e_cc7095792527.slice/crio-dbdeb1fda75b50ec80aa5b365755c52a2aa6da82bb92d70849e7056c0f89dda5 WatchSource:0}: Error finding container dbdeb1fda75b50ec80aa5b365755c52a2aa6da82bb92d70849e7056c0f89dda5: Status 404 returned error can't find the container with id dbdeb1fda75b50ec80aa5b365755c52a2aa6da82bb92d70849e7056c0f89dda5 Jun 09 09:36:51.242607 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:51.242570 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnj7b" event={"ID":"dae0a142-1767-4ed7-813e-cc7095792527","Type":"ContainerStarted","Data":"dbdeb1fda75b50ec80aa5b365755c52a2aa6da82bb92d70849e7056c0f89dda5"} Jun 09 09:36:52.126257 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.126218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:36:52.128450 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.128428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6460d810-7ac0-4a30-81c0-3bc4f4454707-metrics-certs\") pod \"network-metrics-daemon-rm8lp\" (UID: \"6460d810-7ac0-4a30-81c0-3bc4f4454707\") " pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:36:52.233400 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.233368 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\"" Jun 09 09:36:52.241635 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.241612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm8lp" Jun 09 09:36:52.247315 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.247285 2560 generic.go:356] "Generic (PLEG): container finished" podID="dae0a142-1767-4ed7-813e-cc7095792527" containerID="9489dab3acaceb2a0225c94b43a65ebdbc76682ed17d7d9e28176634c2f70284" exitCode=0 Jun 09 09:36:52.247428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.247323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnj7b" event={"ID":"dae0a142-1767-4ed7-813e-cc7095792527","Type":"ContainerDied","Data":"9489dab3acaceb2a0225c94b43a65ebdbc76682ed17d7d9e28176634c2f70284"} Jun 09 09:36:52.377543 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:52.377518 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm8lp"] Jun 09 09:36:52.379615 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:52.379590 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6460d810_7ac0_4a30_81c0_3bc4f4454707.slice/crio-24dda07a77f68810b4c6add3030995ffd2c4a49a21933dca434866e5345fc5d7 WatchSource:0}: Error finding container 24dda07a77f68810b4c6add3030995ffd2c4a49a21933dca434866e5345fc5d7: Status 404 returned error can't find the container with id 24dda07a77f68810b4c6add3030995ffd2c4a49a21933dca434866e5345fc5d7 Jun 09 09:36:53.254665 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:53.254627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm8lp" event={"ID":"6460d810-7ac0-4a30-81c0-3bc4f4454707","Type":"ContainerStarted","Data":"24dda07a77f68810b4c6add3030995ffd2c4a49a21933dca434866e5345fc5d7"} Jun 09 09:36:53.257056 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:53.257021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnj7b" event={"ID":"dae0a142-1767-4ed7-813e-cc7095792527","Type":"ContainerStarted","Data":"9d3cc1e0df056cde8999bc12f8f58ac231812a26d434d32637e99690fff03126"} Jun 09 09:36:53.257204 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:53.257067 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnj7b" event={"ID":"dae0a142-1767-4ed7-813e-cc7095792527","Type":"ContainerStarted","Data":"43b275d27ffaf3dc427fc9b1e9760c818955e33e0c49cee2d0c2651ab93eeb2d"} Jun 09 09:36:53.278400 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:53.278339 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rnj7b" podStartSLOduration=2.259351931 podStartE2EDuration="3.278317237s" totalImagesPullingTime="953.198554ms" totalInitContainerRuntime="65.766752ms" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:53.275719077 +0000 UTC m=+252.423127416" watchObservedRunningTime="2026-06-09 09:36:53.278317237 +0000 UTC m=+252.425725590" Jun 09 09:36:54.263183 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:54.263139 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm8lp" event={"ID":"6460d810-7ac0-4a30-81c0-3bc4f4454707","Type":"ContainerStarted","Data":"a2527261a19d7d9b0bdb7e41bfff68248c7689195d2915ae927de8f6def1dce8"} Jun 09 09:36:54.263731 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:54.263201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm8lp" event={"ID":"6460d810-7ac0-4a30-81c0-3bc4f4454707","Type":"ContainerStarted","Data":"59cd539e3facb57d5aecf354e54e8ea6e6fe21d996e2077ad7e2c4d9e3a2e014"} Jun 09 09:36:54.284493 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:54.284447 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm8lp" podStartSLOduration=252.145691251 podStartE2EDuration="4m13.284430305s" totalImagesPullingTime="1.138739054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:54.282829968 +0000 UTC m=+253.430238306" watchObservedRunningTime="2026-06-09 09:36:54.284430305 +0000 UTC m=+253.431838641" Jun 09 09:36:55.047823 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.047783 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl"] Jun 09 09:36:55.051254 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.051225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.057448 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.056694 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 09:36:55.057448 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.056714 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-59ll4\"" Jun 09 09:36:55.060965 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.060942 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl"] Jun 09 09:36:55.154735 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.154695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpfn7\" (UniqueName: \"kubernetes.io/projected/4b5636a9-5e42-42af-8bb0-7c9131860939-kube-api-access-rpfn7\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.154920 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.154745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b5636a9-5e42-42af-8bb0-7c9131860939-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.255262 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.255227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpfn7\" (UniqueName: \"kubernetes.io/projected/4b5636a9-5e42-42af-8bb0-7c9131860939-kube-api-access-rpfn7\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.255262 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.255261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b5636a9-5e42-42af-8bb0-7c9131860939-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.257619 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.257598 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b5636a9-5e42-42af-8bb0-7c9131860939-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.265860 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.265838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpfn7\" (UniqueName: \"kubernetes.io/projected/4b5636a9-5e42-42af-8bb0-7c9131860939-kube-api-access-rpfn7\") pod \"monitoring-plugin-76b68cc874-jzpnl\" (UID: \"4b5636a9-5e42-42af-8bb0-7c9131860939\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.365696 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.365658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:55.486917 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:55.486887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl"] Jun 09 09:36:55.489540 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:55.489514 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5636a9_5e42_42af_8bb0_7c9131860939.slice/crio-0b0fdd9839614098fb067a196e81ad793b632b5a1f87ab5b3ffc89e76fe057f5 WatchSource:0}: Error finding container 0b0fdd9839614098fb067a196e81ad793b632b5a1f87ab5b3ffc89e76fe057f5: Status 404 returned error can't find the container with id 0b0fdd9839614098fb067a196e81ad793b632b5a1f87ab5b3ffc89e76fe057f5 Jun 09 09:36:56.273351 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.273317 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" event={"ID":"4b5636a9-5e42-42af-8bb0-7c9131860939","Type":"ContainerStarted","Data":"0b0fdd9839614098fb067a196e81ad793b632b5a1f87ab5b3ffc89e76fe057f5"} Jun 09 09:36:56.459381 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.457717 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:36:56.462216 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.462185 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.465997 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.465783 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 09:36:56.465997 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.465796 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 09:36:56.465997 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.465785 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 09:36:56.465997 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.465867 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 09:36:56.465997 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.465788 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 09:36:56.466518 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466487 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 09:36:56.466590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466515 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 09:36:56.466590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466548 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 09:36:56.466590 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466550 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-780e81p076o0e\"" Jun 09 09:36:56.466700 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466493 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 09:36:56.466700 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466493 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 09:36:56.467134 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.466906 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 09:36:56.467134 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.467094 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 09:36:56.467317 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.467215 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ks7vj\"" Jun 09 09:36:56.467317 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.467094 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 09:36:56.467620 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.467599 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 09:36:56.469071 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.468965 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 09:36:56.477072 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.477051 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:36:56.568552 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568552 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.568794 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569028 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569028 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569028 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.568982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569028 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t79\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569117 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569177 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569380 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569380 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.569380 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.569261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.669978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t79\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.670924 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.670632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.671037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.671160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.671922 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.671266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.672798 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.672769 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.675157 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.674676 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.675157 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.674723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.675392 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.675368 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.675755 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.675719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.676411 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.676386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.676674 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.676649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.678310 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.678285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.678734 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.678694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.679812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.679479 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t79\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.679812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.679647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.679812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.679721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.679812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.679787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.679812 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.679786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.680405 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.680379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.681176 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.681156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.681540 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.681514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:56.778343 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:56.778300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:36:57.212479 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.212452 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:36:57.216031 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:36:57.216006 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75f982f_c407_4828_84c3_c6ceac23d4b6.slice/crio-731ddc903ebf10f918b038cf6e212e76b5542783f6f6fe42317165db2b53f99c WatchSource:0}: Error finding container 731ddc903ebf10f918b038cf6e212e76b5542783f6f6fe42317165db2b53f99c: Status 404 returned error can't find the container with id 731ddc903ebf10f918b038cf6e212e76b5542783f6f6fe42317165db2b53f99c Jun 09 09:36:57.278697 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.278666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" event={"ID":"4b5636a9-5e42-42af-8bb0-7c9131860939","Type":"ContainerStarted","Data":"de49b7070bbc8f217778f402d6b120500ed4260e20df7b4e19b604750be8a416"} Jun 09 09:36:57.279131 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.278833 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:57.280019 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.279994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"731ddc903ebf10f918b038cf6e212e76b5542783f6f6fe42317165db2b53f99c"} Jun 09 09:36:57.284018 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.283996 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" Jun 09 09:36:57.299463 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:57.299424 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jzpnl" podStartSLOduration=0.663442464 podStartE2EDuration="2.299410237s" totalImagesPullingTime="1.635967773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:57.298305951 +0000 UTC m=+256.445714300" watchObservedRunningTime="2026-06-09 09:36:57.299410237 +0000 UTC m=+256.446818591" Jun 09 09:36:58.285338 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:58.285295 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3" exitCode=0 Jun 09 09:36:58.285755 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:36:58.285347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3"} Jun 09 09:37:03.307810 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:03.307729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36"} Jun 09 09:37:03.308166 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:03.307823 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8"} Jun 09 09:37:05.319677 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:05.319592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d"} Jun 09 09:37:05.319677 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:05.319655 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c"} Jun 09 09:37:05.319677 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:05.319680 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e"} Jun 09 09:37:05.320258 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:05.319706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerStarted","Data":"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6"} Jun 09 09:37:05.351338 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:05.349762 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.806864017 podStartE2EDuration="9.349734989s" totalImagesPullingTime="7.525499649s" totalInitContainerRuntime="17.371323ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:05.348309997 +0000 UTC m=+264.495718333" watchObservedRunningTime="2026-06-09 09:37:05.349734989 +0000 UTC m=+264.497143326" Jun 09 09:37:06.779233 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:06.779199 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:37:22.963584 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:37:22.963546 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bt472" podUID="6fbdf18c-f6ac-49fc-98a5-37dd04889610" Jun 09 09:37:22.963584 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:37:22.963567 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" Jun 09 09:37:23.381685 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:23.381654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bt472" Jun 09 09:37:23.381685 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:23.381684 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:26.836687 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.836647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:37:26.836687 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.836692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:26.838976 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.838950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbdf18c-f6ac-49fc-98a5-37dd04889610-metrics-tls\") pod \"dns-default-bt472\" (UID: \"6fbdf18c-f6ac-49fc-98a5-37dd04889610\") " pod="openshift-dns/dns-default-bt472" Jun 09 09:37:26.839160 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.839111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"image-registry-795c9768c6-fb57g\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:26.986787 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.986703 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\"" Jun 09 09:37:26.986787 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.986707 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6f9wj\"" Jun 09 09:37:26.993991 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.993960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:26.993991 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:26.993994 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bt472" Jun 09 09:37:27.147175 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.147115 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:37:27.149449 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:37:27.149424 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e29533_0e13_4e86_acb2_7ebaa409204b.slice/crio-af30139ef13f01b898d0da372e9af2dbaf615692aa2ebfc653345cbff094075c WatchSource:0}: Error finding container af30139ef13f01b898d0da372e9af2dbaf615692aa2ebfc653345cbff094075c: Status 404 returned error can't find the container with id af30139ef13f01b898d0da372e9af2dbaf615692aa2ebfc653345cbff094075c Jun 09 09:37:27.158889 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.158867 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bt472"] Jun 09 09:37:27.163079 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:37:27.163054 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbdf18c_f6ac_49fc_98a5_37dd04889610.slice/crio-a408764bca9c1ff9c0ecd773d27896b80e5d5f19565fa8ec0493e9f5f87fcbd0 WatchSource:0}: Error finding container a408764bca9c1ff9c0ecd773d27896b80e5d5f19565fa8ec0493e9f5f87fcbd0: Status 404 returned error can't find the container with id a408764bca9c1ff9c0ecd773d27896b80e5d5f19565fa8ec0493e9f5f87fcbd0 Jun 09 09:37:27.399205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.399163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bt472" event={"ID":"6fbdf18c-f6ac-49fc-98a5-37dd04889610","Type":"ContainerStarted","Data":"a408764bca9c1ff9c0ecd773d27896b80e5d5f19565fa8ec0493e9f5f87fcbd0"} Jun 09 09:37:27.400818 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.400779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" event={"ID":"76e29533-0e13-4e86-acb2-7ebaa409204b","Type":"ContainerStarted","Data":"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084"} Jun 09 09:37:27.400946 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.400827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" event={"ID":"76e29533-0e13-4e86-acb2-7ebaa409204b","Type":"ContainerStarted","Data":"af30139ef13f01b898d0da372e9af2dbaf615692aa2ebfc653345cbff094075c"} Jun 09 09:37:27.400946 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.400885 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:27.420530 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:27.420469 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" podStartSLOduration=286.420449398 podStartE2EDuration="4m46.420449398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:27.419690421 +0000 UTC m=+286.567098759" watchObservedRunningTime="2026-06-09 09:37:27.420449398 +0000 UTC m=+286.567857738" Jun 09 09:37:31.416946 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:31.416909 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bt472" event={"ID":"6fbdf18c-f6ac-49fc-98a5-37dd04889610","Type":"ContainerStarted","Data":"56842ba35a76f3090c231d6ddf4de135c8e21767181fc85d7b9df3cf23fade20"} Jun 09 09:37:31.417388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:31.417005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bt472" event={"ID":"6fbdf18c-f6ac-49fc-98a5-37dd04889610","Type":"ContainerStarted","Data":"3b4d4989081c9e5dda0fb168138f5cce78d24635ea29ba01530b30da109fae17"} Jun 09 09:37:31.417388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:31.417035 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bt472" Jun 09 09:37:31.435107 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:31.435060 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bt472" podStartSLOduration=252.029167902 podStartE2EDuration="4m15.435028919s" totalImagesPullingTime="3.405861017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:31.434150323 +0000 UTC m=+290.581558685" watchObservedRunningTime="2026-06-09 09:37:31.435028919 +0000 UTC m=+290.582437256" Jun 09 09:37:35.431578 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:35.431545 2560 generic.go:356] "Generic (PLEG): container finished" podID="89a5d80b-5212-49e3-92b8-af5bdf33b9e1" containerID="dfcbba68959de7edea33de321c6ce50bc4ff4119592e05042e37b0f3bcacd5c6" exitCode=0 Jun 09 09:37:35.431995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:35.431617 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" event={"ID":"89a5d80b-5212-49e3-92b8-af5bdf33b9e1","Type":"ContainerDied","Data":"dfcbba68959de7edea33de321c6ce50bc4ff4119592e05042e37b0f3bcacd5c6"} Jun 09 09:37:35.431995 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:35.431924 2560 scope.go:117] "RemoveContainer" containerID="dfcbba68959de7edea33de321c6ce50bc4ff4119592e05042e37b0f3bcacd5c6" Jun 09 09:37:36.437409 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:36.437368 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-xgcw8" event={"ID":"89a5d80b-5212-49e3-92b8-af5bdf33b9e1","Type":"ContainerStarted","Data":"3cb940925be3efeecae2dc8988015e352a07cb51b94e2aa6335d73abefec88ee"} Jun 09 09:37:40.730606 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:40.730573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-zrzwr_49485b71-8cf3-4e5b-a1d4-3ab112cbe341/cluster-monitoring-operator/0.log" Jun 09 09:37:41.274071 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:41.274044 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:37:41.278535 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:41.278506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:37:41.281046 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:41.281023 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 09:37:41.422770 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:41.422741 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bt472" Jun 09 09:37:41.729908 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:41.729880 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-jzpnl_4b5636a9-5e42-42af-8bb0-7c9131860939/monitoring-plugin/0.log" Jun 09 09:37:42.527655 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:42.527629 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/init-textfile/0.log" Jun 09 09:37:42.729067 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:42.729038 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/node-exporter/0.log" Jun 09 09:37:42.927932 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:42.927902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/kube-rbac-proxy/0.log" Jun 09 09:37:44.328201 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:44.328172 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/init-config-reloader/0.log" Jun 09 09:37:44.529577 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:44.529548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/prometheus/0.log" Jun 09 09:37:44.727863 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:44.727831 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/config-reloader/0.log" Jun 09 09:37:44.927847 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:44.927821 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/thanos-sidecar/0.log" Jun 09 09:37:45.127658 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:45.127627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/kube-rbac-proxy-web/0.log" Jun 09 09:37:45.327480 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:45.327450 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/kube-rbac-proxy/0.log" Jun 09 09:37:45.528253 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:45.528165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c75f982f-c407-4828-84c3-c6ceac23d4b6/kube-rbac-proxy-thanos/0.log" Jun 09 09:37:45.729762 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:45.729730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fgngl_50313f55-6c0f-4f0f-b93b-a0cdf96b1b04/prometheus-operator/0.log" Jun 09 09:37:45.928754 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:45.928715 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fgngl_50313f55-6c0f-4f0f-b93b-a0cdf96b1b04/kube-rbac-proxy/0.log" Jun 09 09:37:46.998312 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:46.998270 2560 patch_prober.go:28] interesting pod/image-registry-795c9768c6-fb57g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 09:37:46.998705 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:46.998333 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 09:37:47.528573 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:47.528542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-5fw4r_401612eb-dbec-40f3-8b8c-dc58da5afbb8/networking-console-plugin/0.log" Jun 09 09:37:48.408859 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:48.408830 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:37:49.128840 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:49.128809 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bt472_6fbdf18c-f6ac-49fc-98a5-37dd04889610/dns/0.log" Jun 09 09:37:49.328815 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:49.328783 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bt472_6fbdf18c-f6ac-49fc-98a5-37dd04889610/kube-rbac-proxy/0.log" Jun 09 09:37:50.328173 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:50.328148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sphx6_00be341c-74ff-47cb-b9e8-236f4cf6f96e/dns-node-resolver/0.log" Jun 09 09:37:50.528092 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:50.528062 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-795c9768c6-fb57g_76e29533-0e13-4e86-acb2-7ebaa409204b/registry/0.log" Jun 09 09:37:50.928270 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:50.928245 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4l64c_37de4ff9-5de8-43e4-acaa-f29d7d4d8750/node-ca/0.log" Jun 09 09:37:51.528164 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:51.528141 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67d79d5f85-q6wwq_b0acb041-2548-4743-912b-8226513f46ad/router/0.log" Jun 09 09:37:52.129762 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:52.129737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwpn7_cd27a57a-af22-46b1-ab35-f58c1aced8fe/serve-healthcheck-canary/0.log" Jun 09 09:37:56.778599 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:56.778563 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:37:56.794578 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:56.794554 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:37:57.533135 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:37:57.533104 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:10.768925 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:10.768890 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:38:14.811765 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.811726 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:14.812199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812020 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="prometheus" containerID="cri-o://c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8" gracePeriod=600 Jun 09 09:38:14.812199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812031 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy" containerID="cri-o://98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c" gracePeriod=600 Jun 09 09:38:14.812199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812105 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d" gracePeriod=600 Jun 09 09:38:14.812199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812136 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="thanos-sidecar" containerID="cri-o://7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6" gracePeriod=600 Jun 09 09:38:14.812418 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812136 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="config-reloader" containerID="cri-o://655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36" gracePeriod=600 Jun 09 09:38:14.812418 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:14.812144 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-web" containerID="cri-o://75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e" gracePeriod=600 Jun 09 09:38:15.594598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594565 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d" exitCode=0 Jun 09 09:38:15.594598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594589 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c" exitCode=0 Jun 09 09:38:15.594598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594596 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6" exitCode=0 Jun 09 09:38:15.594598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594602 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36" exitCode=0 Jun 09 09:38:15.594598 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594607 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8" exitCode=0 Jun 09 09:38:15.594891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d"} Jun 09 09:38:15.594891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594710 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c"} Jun 09 09:38:15.594891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594741 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6"} Jun 09 09:38:15.594891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594764 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36"} Jun 09 09:38:15.594891 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:15.594787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8"} Jun 09 09:38:16.054398 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.054374 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.163510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163426 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163464 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163503 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163526 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163543 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163560 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163578 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163600 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163632 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163665 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163695 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163724 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163752 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9t79\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.163786 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163783 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163808 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163859 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163895 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163933 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163935 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163967 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.163998 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2\") pod \"c75f982f-c407-4828-84c3-c6ceac23d4b6\" (UID: \"c75f982f-c407-4828-84c3-c6ceac23d4b6\") " Jun 09 09:38:16.164388 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.164295 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.164773 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.164631 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.165097 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.165183 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.165605 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.165914 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.166489 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.166620 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.167350 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.167315 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:16.167788 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.167589 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.167788 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.167658 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config" (OuterVolumeSpecName: "config") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.167911 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.167882 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.168601 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.168557 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.168703 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.168599 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.168984 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.168955 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.169064 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.169028 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.169141 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.169100 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:16.169194 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.169162 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out" (OuterVolumeSpecName: "config-out") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:38:16.169236 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.169198 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79" (OuterVolumeSpecName: "kube-api-access-m9t79") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "kube-api-access-m9t79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:16.179010 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.178990 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config" (OuterVolumeSpecName: "web-config") pod "c75f982f-c407-4828-84c3-c6ceac23d4b6" (UID: "c75f982f-c407-4828-84c3-c6ceac23d4b6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:16.265199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265162 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-config\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265199 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265193 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265223 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-web-config\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265233 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265244 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-metrics-client-ca\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265252 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-config-out\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265261 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-metrics-client-certs\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265272 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265282 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265290 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9t79\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-kube-api-access-m9t79\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265299 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-db\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265307 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-grpc-tls\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265317 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-kube-rbac-proxy\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265325 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265333 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75f982f-c407-4828-84c3-c6ceac23d4b6-tls-assets\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265341 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265348 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75f982f-c407-4828-84c3-c6ceac23d4b6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265356 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.265383 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.265364 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75f982f-c407-4828-84c3-c6ceac23d4b6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:16.602051 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.602021 2560 generic.go:356] "Generic (PLEG): container finished" podID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerID="75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e" exitCode=0 Jun 09 09:38:16.602226 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.602098 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e"} Jun 09 09:38:16.602226 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.602168 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75f982f-c407-4828-84c3-c6ceac23d4b6","Type":"ContainerDied","Data":"731ddc903ebf10f918b038cf6e212e76b5542783f6f6fe42317165db2b53f99c"} Jun 09 09:38:16.602226 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.602099 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.602226 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.602200 2560 scope.go:117] "RemoveContainer" containerID="b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d" Jun 09 09:38:16.611103 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.611081 2560 scope.go:117] "RemoveContainer" containerID="98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c" Jun 09 09:38:16.618085 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.618067 2560 scope.go:117] "RemoveContainer" containerID="75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e" Jun 09 09:38:16.624698 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.624676 2560 scope.go:117] "RemoveContainer" containerID="7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6" Jun 09 09:38:16.626408 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.626388 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:16.632700 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.632357 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:16.638653 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.638630 2560 scope.go:117] "RemoveContainer" containerID="655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36" Jun 09 09:38:16.645791 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.645776 2560 scope.go:117] "RemoveContainer" containerID="c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8" Jun 09 09:38:16.653036 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.653019 2560 scope.go:117] "RemoveContainer" containerID="cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3" Jun 09 09:38:16.657604 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.657583 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:16.658044 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658024 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-thanos" Jun 09 09:38:16.658095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658050 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-thanos" Jun 09 09:38:16.658095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658066 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="config-reloader" Jun 09 09:38:16.658095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658077 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="config-reloader" Jun 09 09:38:16.658095 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658092 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="prometheus" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658100 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="prometheus" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658114 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658141 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658154 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="init-config-reloader" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658164 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="init-config-reloader" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658174 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-web" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658183 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-web" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658196 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="thanos-sidecar" Jun 09 09:38:16.658229 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658204 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="thanos-sidecar" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658283 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="prometheus" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658296 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-web" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658305 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy-thanos" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658317 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="thanos-sidecar" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658325 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="kube-rbac-proxy" Jun 09 09:38:16.658485 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.658333 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" containerName="config-reloader" Jun 09 09:38:16.660689 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.660667 2560 scope.go:117] "RemoveContainer" containerID="b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d" Jun 09 09:38:16.660940 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.660917 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d\": container with ID starting with b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d not found: ID does not exist" containerID="b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d" Jun 09 09:38:16.661002 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.660946 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d"} err="failed to get container status \"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d\": rpc error: code = NotFound desc = could not find container \"b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d\": container with ID starting with b4f26e533013ffdb2e6c858a18632ec423397c66c506ff336e837b685ecde28d not found: ID does not exist" Jun 09 09:38:16.661002 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.660976 2560 scope.go:117] "RemoveContainer" containerID="98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c" Jun 09 09:38:16.661288 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.661268 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c\": container with ID starting with 98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c not found: ID does not exist" containerID="98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c" Jun 09 09:38:16.661368 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661333 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c"} err="failed to get container status \"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c\": rpc error: code = NotFound desc = could not find container \"98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c\": container with ID starting with 98d513edff460ca7d3d6917b9351e29df2b208d300e838f8687a6c3ecf1b3d3c not found: ID does not exist" Jun 09 09:38:16.661368 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661347 2560 scope.go:117] "RemoveContainer" containerID="75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e" Jun 09 09:38:16.661598 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.661580 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e\": container with ID starting with 75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e not found: ID does not exist" containerID="75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e" Jun 09 09:38:16.661649 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661602 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e"} err="failed to get container status \"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e\": rpc error: code = NotFound desc = could not find container \"75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e\": container with ID starting with 75aac4c9a2f903fdaad6b8497452886b86301ba0e96509cc5faac088c45ec31e not found: ID does not exist" Jun 09 09:38:16.661649 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661618 2560 scope.go:117] "RemoveContainer" containerID="7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6" Jun 09 09:38:16.661837 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.661818 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6\": container with ID starting with 7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6 not found: ID does not exist" containerID="7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6" Jun 09 09:38:16.661881 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661843 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6"} err="failed to get container status \"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6\": rpc error: code = NotFound desc = could not find container \"7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6\": container with ID starting with 7a63c7a2bb5f55e8f9308fd9d7353b2188a41235435340ff15573f57c53b88c6 not found: ID does not exist" Jun 09 09:38:16.661881 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.661858 2560 scope.go:117] "RemoveContainer" containerID="655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36" Jun 09 09:38:16.662076 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.662055 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36\": container with ID starting with 655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36 not found: ID does not exist" containerID="655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36" Jun 09 09:38:16.662116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.662082 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36"} err="failed to get container status \"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36\": rpc error: code = NotFound desc = could not find container \"655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36\": container with ID starting with 655095960f0f9d0a9361b74e0815d1fe950bcd738b50776ef723679b0960ee36 not found: ID does not exist" Jun 09 09:38:16.662116 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.662102 2560 scope.go:117] "RemoveContainer" containerID="c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8" Jun 09 09:38:16.662347 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.662331 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8\": container with ID starting with c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8 not found: ID does not exist" containerID="c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8" Jun 09 09:38:16.662434 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.662351 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8"} err="failed to get container status \"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8\": rpc error: code = NotFound desc = could not find container \"c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8\": container with ID starting with c71fad82e66203457a6021bac0e93d5efe64d1eceb93b73ca0cf3852dbabf8d8 not found: ID does not exist" Jun 09 09:38:16.662434 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.662366 2560 scope.go:117] "RemoveContainer" containerID="cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3" Jun 09 09:38:16.662571 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:16.662536 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3\": container with ID starting with cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3 not found: ID does not exist" containerID="cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3" Jun 09 09:38:16.662571 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.662556 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3"} err="failed to get container status \"cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3\": rpc error: code = NotFound desc = could not find container \"cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3\": container with ID starting with cef76ab168aacc1fbde46f8e031a7779ae8df7242b80713a3b8cd740298a49e3 not found: ID does not exist" Jun 09 09:38:16.663989 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.663974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.666930 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666770 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-780e81p076o0e\"" Jun 09 09:38:16.666930 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666790 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 09:38:16.666930 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 09:38:16.666930 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666776 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 09:38:16.666930 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666868 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 09:38:16.667273 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.666934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 09:38:16.667273 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667018 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ks7vj\"" Jun 09 09:38:16.667273 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667188 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 09:38:16.667428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 09:38:16.667428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667388 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 09:38:16.667428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667399 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 09:38:16.667428 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667425 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 09:38:16.667627 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667431 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 09:38:16.667692 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667670 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 09:38:16.667743 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.667674 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 09:38:16.669196 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.669171 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 09:38:16.672693 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.672674 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 09:38:16.686816 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.686791 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:16.769396 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769436 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769526 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769564 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p5q6\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-kube-api-access-8p5q6\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769590 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.769783 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.770008 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.770008 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.770008 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.770008 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.769922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871356 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871356 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871356 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871579 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871579 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871579 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871831 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871831 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p5q6\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-kube-api-access-8p5q6\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.871831 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.871643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872618 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872736 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872736 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872736 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872784 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.872904 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.873257 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.873257 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.872939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.874714 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.874440 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.874714 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.874520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.874714 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.874557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.874714 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.874629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.874714 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.874666 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875255 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875229 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875458 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875436 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875528 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875681 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875751 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875727 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.875811 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.875467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.876072 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.876046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.876237 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.876184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.876304 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.876267 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b682933-95ad-41fc-9d14-7b212bea0131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.876706 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.876681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.876883 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.876865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.877346 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.877331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.877678 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.877662 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b682933-95ad-41fc-9d14-7b212bea0131-config\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.879765 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.879746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p5q6\" (UniqueName: \"kubernetes.io/projected/0b682933-95ad-41fc-9d14-7b212bea0131-kube-api-access-8p5q6\") pod \"prometheus-k8s-0\" (UID: \"0b682933-95ad-41fc-9d14-7b212bea0131\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:16.974970 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:16.974928 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:17.112567 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:17.112538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 09:38:17.114295 ip-10-0-133-109 kubenswrapper[2560]: W0609 09:38:17.114263 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b682933_95ad_41fc_9d14_7b212bea0131.slice/crio-e265c4cd71a71c33971e57cf90dc1f7be6f263f334dd657f4f599b4c8509b0dc WatchSource:0}: Error finding container e265c4cd71a71c33971e57cf90dc1f7be6f263f334dd657f4f599b4c8509b0dc: Status 404 returned error can't find the container with id e265c4cd71a71c33971e57cf90dc1f7be6f263f334dd657f4f599b4c8509b0dc Jun 09 09:38:17.334401 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:17.334373 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75f982f-c407-4828-84c3-c6ceac23d4b6" path="/var/lib/kubelet/pods/c75f982f-c407-4828-84c3-c6ceac23d4b6/volumes" Jun 09 09:38:17.607817 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:17.607786 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b682933-95ad-41fc-9d14-7b212bea0131" containerID="029e1f81d016e828afa8db20f211ddbddbe85ac739a175537ba509f22441ce75" exitCode=0 Jun 09 09:38:17.607981 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:17.607853 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerDied","Data":"029e1f81d016e828afa8db20f211ddbddbe85ac739a175537ba509f22441ce75"} Jun 09 09:38:17.607981 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:17.607914 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"e265c4cd71a71c33971e57cf90dc1f7be6f263f334dd657f4f599b4c8509b0dc"} Jun 09 09:38:18.616716 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"19d0d8429abd0685055b6a0529977fa9e396332a9af031816caf25f4c5816b7f"} Jun 09 09:38:18.617205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"ebc7f72916ea9b9c5a92477a5a4180d71a67853cf4600a24e75e71f29898fa77"} Jun 09 09:38:18.617205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616804 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"a6ba8e0bb3a3b699d47cdb47b66c1e5b8fdea4b16bb2c327f3c53eda18ff3dde"} Jun 09 09:38:18.617205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616841 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"d9564359524646e90f5ba5e9bf5f26d03acc87e44af1fb15aa22fba1616b4ced"} Jun 09 09:38:18.617205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616876 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"681ca59652f8181ac84bb383093a768c94713fbfbc9f317dcbf77241d4a2d3e0"} Jun 09 09:38:18.617205 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.616910 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b682933-95ad-41fc-9d14-7b212bea0131","Type":"ContainerStarted","Data":"26040f24f306c2c7fd851797ec15b485d80ab69e5fe57c569d8f4937fccd1620"} Jun 09 09:38:18.645536 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:18.645471 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.626120181 podStartE2EDuration="2.64544919s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.329009ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:38:18.643602944 +0000 UTC m=+337.791011339" watchObservedRunningTime="2026-06-09 09:38:18.64544919 +0000 UTC m=+337.792857528" Jun 09 09:38:21.975980 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:21.975946 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:38:35.794250 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:35.794142 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerName="registry" containerID="cri-o://2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084" gracePeriod=30 Jun 09 09:38:36.039036 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.039008 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045684 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045761 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045799 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkpjr\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045859 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045910 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.045952 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.046011 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.047327 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.046055 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token\") pod \"76e29533-0e13-4e86-acb2-7ebaa409204b\" (UID: \"76e29533-0e13-4e86-acb2-7ebaa409204b\") " Jun 09 09:38:36.048800 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.048766 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr" (OuterVolumeSpecName: "kube-api-access-qkpjr") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "kube-api-access-qkpjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:36.049243 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.049214 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:36.050651 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.050622 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:36.050756 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.050640 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:38:36.051458 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.051430 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:38:36.052169 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.052094 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:36.052761 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.052740 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:38:36.058510 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.058484 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "76e29533-0e13-4e86-acb2-7ebaa409204b" (UID: "76e29533-0e13-4e86-acb2-7ebaa409204b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:38:36.148331 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148297 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkpjr\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-kube-api-access-qkpjr\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148331 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148326 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-certificates\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148331 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148336 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-installation-pull-secrets\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148585 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148344 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76e29533-0e13-4e86-acb2-7ebaa409204b-ca-trust-extracted\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148585 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148354 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76e29533-0e13-4e86-acb2-7ebaa409204b-image-registry-private-configuration\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148585 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148364 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-bound-sa-token\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148585 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148373 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76e29533-0e13-4e86-acb2-7ebaa409204b-trusted-ca\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.148585 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.148381 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76e29533-0e13-4e86-acb2-7ebaa409204b-registry-tls\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 09:38:36.689276 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.689243 2560 generic.go:356] "Generic (PLEG): container finished" podID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerID="2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084" exitCode=0 Jun 09 09:38:36.689429 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.689300 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" Jun 09 09:38:36.689429 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.689329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" event={"ID":"76e29533-0e13-4e86-acb2-7ebaa409204b","Type":"ContainerDied","Data":"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084"} Jun 09 09:38:36.689429 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.689381 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795c9768c6-fb57g" event={"ID":"76e29533-0e13-4e86-acb2-7ebaa409204b","Type":"ContainerDied","Data":"af30139ef13f01b898d0da372e9af2dbaf615692aa2ebfc653345cbff094075c"} Jun 09 09:38:36.689429 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.689402 2560 scope.go:117] "RemoveContainer" containerID="2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084" Jun 09 09:38:36.697948 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.697929 2560 scope.go:117] "RemoveContainer" containerID="2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084" Jun 09 09:38:36.698298 ip-10-0-133-109 kubenswrapper[2560]: E0609 09:38:36.698279 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084\": container with ID starting with 2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084 not found: ID does not exist" containerID="2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084" Jun 09 09:38:36.698372 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.698310 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084"} err="failed to get container status \"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084\": rpc error: code = NotFound desc = could not find container \"2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084\": container with ID starting with 2d023af5bb03e66855b2bc29f2dea63b261afd27ed7fa526ac4c6b379c455084 not found: ID does not exist" Jun 09 09:38:36.711931 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.711896 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:38:36.714526 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:36.714504 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-795c9768c6-fb57g"] Jun 09 09:38:37.333868 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:38:37.333836 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" path="/var/lib/kubelet/pods/76e29533-0e13-4e86-acb2-7ebaa409204b/volumes" Jun 09 09:39:16.976180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:39:16.976141 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:39:16.991368 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:39:16.991344 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:39:17.856038 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:39:17.856010 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 09:42:41.299016 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:42:41.298982 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:42:41.300717 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:42:41.300693 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:47:41.325470 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:47:41.325438 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:47:41.331031 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:47:41.331009 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:52:41.352457 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:52:41.352428 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:52:41.353180 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:52:41.353158 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:57:41.376138 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:57:41.376090 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 09:57:41.376671 ip-10-0-133-109 kubenswrapper[2560]: I0609 09:57:41.376511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:02:41.398584 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:02:41.398552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:02:41.399235 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:02:41.399217 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:07:41.420655 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:07:41.420627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:07:41.421782 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:07:41.421763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:10:25.886785 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:25.886711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kcphz_1aad92e5-7b4b-4315-b502-8e651c2ea476/global-pull-secret-syncer/0.log" Jun 09 10:10:26.093277 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:26.093247 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjgq6_1a2b6496-7511-4181-9ab7-f527a0983fb5/konnectivity-agent/0.log" Jun 09 10:10:26.134750 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:26.134722 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-109.ec2.internal_627b185f30291ffb2e9813e90451a240/haproxy/0.log" Jun 09 10:10:30.257439 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.257408 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-zrzwr_49485b71-8cf3-4e5b-a1d4-3ab112cbe341/cluster-monitoring-operator/0.log" Jun 09 10:10:30.413108 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.413081 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-jzpnl_4b5636a9-5e42-42af-8bb0-7c9131860939/monitoring-plugin/0.log" Jun 09 10:10:30.541766 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.541739 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/node-exporter/0.log" Jun 09 10:10:30.563073 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.563046 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/kube-rbac-proxy/0.log" Jun 09 10:10:30.585278 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.585248 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnj7b_dae0a142-1767-4ed7-813e-cc7095792527/init-textfile/0.log" Jun 09 10:10:30.799556 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.799479 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/prometheus/0.log" Jun 09 10:10:30.823207 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.823184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/config-reloader/0.log" Jun 09 10:10:30.852003 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.851979 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/thanos-sidecar/0.log" Jun 09 10:10:30.878115 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.878089 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/kube-rbac-proxy-web/0.log" Jun 09 10:10:30.903878 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.903856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/kube-rbac-proxy/0.log" Jun 09 10:10:30.939874 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.939849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/kube-rbac-proxy-thanos/0.log" Jun 09 10:10:30.976837 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:30.976808 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b682933-95ad-41fc-9d14-7b212bea0131/init-config-reloader/0.log" Jun 09 10:10:31.015332 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:31.015300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fgngl_50313f55-6c0f-4f0f-b93b-a0cdf96b1b04/prometheus-operator/0.log" Jun 09 10:10:31.054193 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:31.054097 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-fgngl_50313f55-6c0f-4f0f-b93b-a0cdf96b1b04/kube-rbac-proxy/0.log" Jun 09 10:10:32.445496 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:32.445465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-5fw4r_401612eb-dbec-40f3-8b8c-dc58da5afbb8/networking-console-plugin/0.log" Jun 09 10:10:33.115449 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.115411 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b"] Jun 09 10:10:33.115713 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.115702 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerName="registry" Jun 09 10:10:33.115767 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.115714 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerName="registry" Jun 09 10:10:33.115767 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.115757 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76e29533-0e13-4e86-acb2-7ebaa409204b" containerName="registry" Jun 09 10:10:33.118503 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.118482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.119723 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.119699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-sys\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.119811 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.119737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-proc\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.119811 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.119757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-podres\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.119811 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.119779 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7p7\" (UniqueName: \"kubernetes.io/projected/668165ef-91dd-4e6f-b0ba-f5652faa1611-kube-api-access-tz7p7\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.119933 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.119897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-lib-modules\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.120872 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.120857 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"kube-root-ca.crt\"" Jun 09 10:10:33.121918 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.121904 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"openshift-service-ca.crt\"" Jun 09 10:10:33.121986 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.121904 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kgxsx\"/\"default-dockercfg-h772p\"" Jun 09 10:10:33.127078 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.127056 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b"] Jun 09 10:10:33.220803 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-proc\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.220982 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-podres\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.220982 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220845 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7p7\" (UniqueName: \"kubernetes.io/projected/668165ef-91dd-4e6f-b0ba-f5652faa1611-kube-api-access-tz7p7\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.220982 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220905 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-lib-modules\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.220982 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-sys\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.220982 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.220953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-proc\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.221221 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.221011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-sys\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.221221 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.221011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-podres\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.221221 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.221092 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668165ef-91dd-4e6f-b0ba-f5652faa1611-lib-modules\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.229401 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.229379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7p7\" (UniqueName: \"kubernetes.io/projected/668165ef-91dd-4e6f-b0ba-f5652faa1611-kube-api-access-tz7p7\") pod \"perf-node-gather-daemonset-b9h9b\" (UID: \"668165ef-91dd-4e6f-b0ba-f5652faa1611\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.429217 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.429099 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.560494 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.560468 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b"] Jun 09 10:10:33.562931 ip-10-0-133-109 kubenswrapper[2560]: W0609 10:10:33.562905 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod668165ef_91dd_4e6f_b0ba_f5652faa1611.slice/crio-b4acfad1ca6c42a66b7684049ccaba93ce62e85c00258f66b26fcbf3b773fb61 WatchSource:0}: Error finding container b4acfad1ca6c42a66b7684049ccaba93ce62e85c00258f66b26fcbf3b773fb61: Status 404 returned error can't find the container with id b4acfad1ca6c42a66b7684049ccaba93ce62e85c00258f66b26fcbf3b773fb61 Jun 09 10:10:33.718001 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.717896 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" event={"ID":"668165ef-91dd-4e6f-b0ba-f5652faa1611","Type":"ContainerStarted","Data":"9be74565d4ba869a065d4416f702409eddab0ba6f4130ae2e8bc8fc02524c1ef"} Jun 09 10:10:33.718180 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.718100 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:33.718180 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.718165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" event={"ID":"668165ef-91dd-4e6f-b0ba-f5652faa1611","Type":"ContainerStarted","Data":"b4acfad1ca6c42a66b7684049ccaba93ce62e85c00258f66b26fcbf3b773fb61"} Jun 09 10:10:33.734042 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:33.733990 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" podStartSLOduration=0.733978469 podStartE2EDuration="733.978469ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:10:33.732903362 +0000 UTC m=+2272.880311709" watchObservedRunningTime="2026-06-09 10:10:33.733978469 +0000 UTC m=+2272.881386805" Jun 09 10:10:34.556940 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:34.556912 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bt472_6fbdf18c-f6ac-49fc-98a5-37dd04889610/dns/0.log" Jun 09 10:10:34.579960 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:34.579932 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bt472_6fbdf18c-f6ac-49fc-98a5-37dd04889610/kube-rbac-proxy/0.log" Jun 09 10:10:34.700682 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:34.700650 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sphx6_00be341c-74ff-47cb-b9e8-236f4cf6f96e/dns-node-resolver/0.log" Jun 09 10:10:35.115967 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:35.115936 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4l64c_37de4ff9-5de8-43e4-acaa-f29d7d4d8750/node-ca/0.log" Jun 09 10:10:35.976135 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:35.976096 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67d79d5f85-q6wwq_b0acb041-2548-4743-912b-8226513f46ad/router/0.log" Jun 09 10:10:36.371274 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:36.371242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwpn7_cd27a57a-af22-46b1-ab35-f58c1aced8fe/serve-healthcheck-canary/0.log" Jun 09 10:10:36.818636 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:36.818571 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ws9m4_78c7a09e-e065-4d1a-a73c-62d0142a8627/kube-rbac-proxy/0.log" Jun 09 10:10:36.838489 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:36.838465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ws9m4_78c7a09e-e065-4d1a-a73c-62d0142a8627/exporter/0.log" Jun 09 10:10:36.859313 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:36.859287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ws9m4_78c7a09e-e065-4d1a-a73c-62d0142a8627/extractor/0.log" Jun 09 10:10:39.731300 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:39.731273 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-b9h9b" Jun 09 10:10:40.904702 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:40.904671 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kqzpl_aeedb5e6-415d-480e-8ebc-ee74dde4d3db/migrator/0.log" Jun 09 10:10:40.946234 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:40.946206 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kqzpl_aeedb5e6-415d-480e-8ebc-ee74dde4d3db/graceful-termination/0.log" Jun 09 10:10:42.289079 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.289052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2lsn5_35de1da8-63e8-4820-9632-6b2bcee5378c/kube-multus/0.log" Jun 09 10:10:42.839601 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.839571 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/kube-multus-additional-cni-plugins/0.log" Jun 09 10:10:42.871692 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.871667 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/egress-router-binary-copy/0.log" Jun 09 10:10:42.902216 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.902189 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/cni-plugins/0.log" Jun 09 10:10:42.929381 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.929354 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/bond-cni-plugin/0.log" Jun 09 10:10:42.959632 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.959563 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/routeoverride-cni/0.log" Jun 09 10:10:42.986610 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:42.986580 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/whereabouts-cni-bincopy/0.log" Jun 09 10:10:43.009904 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:43.009879 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szqfv_a6055c8f-bfa2-4e2b-a2ef-9e4864e8a6f7/whereabouts-cni/0.log" Jun 09 10:10:43.151694 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:43.151672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm8lp_6460d810-7ac0-4a30-81c0-3bc4f4454707/network-metrics-daemon/0.log" Jun 09 10:10:43.175518 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:43.175498 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm8lp_6460d810-7ac0-4a30-81c0-3bc4f4454707/kube-rbac-proxy/0.log" Jun 09 10:10:44.327427 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.327397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-controller/0.log" Jun 09 10:10:44.350251 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.350225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/0.log" Jun 09 10:10:44.350251 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.350233 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovn-acl-logging/1.log" Jun 09 10:10:44.371614 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.371583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/kube-rbac-proxy-node/0.log" Jun 09 10:10:44.396758 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.396730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 10:10:44.417649 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.417626 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/northd/0.log" Jun 09 10:10:44.442216 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.442145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/nbdb/0.log" Jun 09 10:10:44.470744 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.470720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/sbdb/0.log" Jun 09 10:10:44.512542 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:44.512506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k46n4_846c9a35-0f7c-4364-a31b-8b6693865f7d/ovnkube-controller/0.log" Jun 09 10:10:45.707453 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:45.707425 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-brxsz_09e825a1-c29b-4ae3-8ef3-db02093e52c5/check-endpoints/0.log" Jun 09 10:10:45.735594 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:45.735567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7zbbc_ce6cde41-52ed-4521-bd85-43e870a25413/network-check-target-container/0.log" Jun 09 10:10:46.789439 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:46.789413 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9p5x2_32dbf27b-ac0e-4208-b604-5ca2a2c3a7cb/iptables-alerter/0.log" Jun 09 10:10:47.457647 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:47.457618 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fqvbz_62b203ac-e7bf-4fb0-a12e-63053a8e31a2/tuned/0.log" Jun 09 10:10:49.198715 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:49.198680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-5c47z_dd769466-da09-499b-9070-a7a34a256a17/cluster-samples-operator/0.log" Jun 09 10:10:49.215264 ip-10-0-133-109 kubenswrapper[2560]: I0609 10:10:49.215240 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-5c47z_dd769466-da09-499b-9070-a7a34a256a17/cluster-samples-operator-watch/0.log"