Jun 12 17:34:42.281473 ip-10-0-129-69 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 17:34:42.281486 ip-10-0-129-69 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 17:34:42.281496 ip-10-0-129-69 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 17:34:42.281798 ip-10-0-129-69 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 17:34:53.568943 ip-10-0-129-69 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 17:34:53.568963 ip-10-0-129-69 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 40087ed149f4489e9c41b3f24291be06 -- Jun 12 17:37:30.831233 ip-10-0-129-69 systemd[1]: Starting Kubernetes Kubelet... Jun 12 17:37:31.277335 ip-10-0-129-69 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 17:37:31.277335 ip-10-0-129-69 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 17:37:31.277335 ip-10-0-129-69 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 17:37:31.277335 ip-10-0-129-69 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 17:37:31.277335 ip-10-0-129-69 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 17:37:31.278291 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.278204 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 17:37:31.282121 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282107 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.282121 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282121 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282125 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282128 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282132 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282135 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282138 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282141 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282145 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282148 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282150 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282153 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282156 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282159 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282161 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282164 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282167 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282169 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282172 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282174 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282177 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.282184 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282180 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282183 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282186 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282188 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282192 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282197 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282200 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282203 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282205 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282207 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282210 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282213 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282215 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282218 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282220 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282223 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282226 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282229 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282233 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.282647 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282237 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282240 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282243 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282245 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282248 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282250 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282253 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282256 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282258 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282261 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282263 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282265 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282268 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282270 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282273 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282276 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282279 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282282 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282284 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.283126 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282286 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282289 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282292 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282294 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282297 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282299 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282302 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282304 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282306 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282309 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282311 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282314 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282316 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282319 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282321 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282325 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282327 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282331 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282334 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282336 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.283572 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282339 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282342 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282344 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282347 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282349 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282351 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282354 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282356 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282360 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282362 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282365 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282367 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282370 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282372 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282375 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282377 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282380 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282382 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282385 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.282387 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.284064 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283101 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283107 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283111 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283114 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283117 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283119 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283122 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283125 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283127 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283130 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283133 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283135 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283139 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283141 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283144 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283146 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283149 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283152 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283154 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283157 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.284574 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283160 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283163 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283165 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283169 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283173 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283176 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283178 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283181 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283183 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283186 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283188 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283190 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283193 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283195 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283198 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283200 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283204 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283208 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283211 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.285075 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283214 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283216 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283219 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283222 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283225 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283227 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283230 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283232 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283235 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283237 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283240 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283242 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283245 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283248 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283250 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283253 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283255 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283258 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283261 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283263 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.285537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283266 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283268 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283270 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283273 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283276 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283278 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283282 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283287 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283289 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283292 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283296 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283299 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283301 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283304 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283306 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283309 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283312 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283314 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283316 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.286035 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283319 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283321 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283324 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283326 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283329 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283332 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283334 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283337 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283339 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283342 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283344 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283347 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283350 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283352 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283354 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283357 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283359 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283361 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283364 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283366 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.286493 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283369 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283776 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283782 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283786 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283789 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283792 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283796 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283799 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283802 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283804 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283807 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283809 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283812 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283815 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283817 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283820 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283823 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283825 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283828 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.286985 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283831 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283833 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283836 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283839 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283841 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283843 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283846 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283848 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283851 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283854 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283856 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283861 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283864 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283866 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283871 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283874 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283877 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283880 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.287427 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283883 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283885 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283888 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283890 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283892 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283894 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283897 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283900 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283902 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283905 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283907 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283909 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283912 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283914 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283917 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283920 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283922 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283940 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283943 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.287881 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283945 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283949 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283951 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283957 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283961 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283964 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283966 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283969 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283971 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283974 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283976 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283979 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283982 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283985 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283988 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283990 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283992 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283995 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.283997 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284000 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.288357 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284004 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284007 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284010 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284013 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284016 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284019 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284021 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284024 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284026 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284029 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284031 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284033 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284036 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284038 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284041 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284047 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284050 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284052 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284054 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284057 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.288863 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284060 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284062 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284064 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284135 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284146 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284153 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284157 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284161 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284164 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284168 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284172 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284175 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284180 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284184 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284187 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284190 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284193 2581 flags.go:64] FLAG: --cgroup-root="" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284196 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284198 2581 flags.go:64] FLAG: --client-ca-file="" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284201 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284204 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284208 2581 flags.go:64] FLAG: --cluster-domain="" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284210 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284215 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 17:37:31.289360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284218 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284221 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284225 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284229 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284232 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284236 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284238 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284241 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284244 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284247 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284250 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284254 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284257 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284259 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284263 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284266 2581 flags.go:64] FLAG: --enable-server="true" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284268 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284273 2581 flags.go:64] FLAG: --event-burst="100" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284276 2581 flags.go:64] FLAG: --event-qps="50" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284279 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284283 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284285 2581 flags.go:64] FLAG: --eviction-hard="" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284289 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284292 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284294 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 17:37:31.289950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284297 2581 flags.go:64] FLAG: --eviction-soft="" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284300 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284302 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284305 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284308 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284311 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284314 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284316 2581 flags.go:64] FLAG: --feature-gates="" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284320 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284323 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284327 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284330 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284333 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284336 2581 flags.go:64] FLAG: --help="false" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284339 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284342 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284344 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284347 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284350 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284353 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284356 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284358 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284364 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 17:37:31.290547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284367 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284370 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284372 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284375 2581 flags.go:64] FLAG: --kube-reserved="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284379 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284382 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284384 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284387 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284390 2581 flags.go:64] FLAG: --lock-file="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284392 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284395 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284398 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284403 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284406 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284408 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284419 2581 flags.go:64] FLAG: --logging-format="text" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284422 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284425 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284428 2581 flags.go:64] FLAG: --manifest-url="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284432 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284437 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284439 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284444 2581 flags.go:64] FLAG: --max-pods="110" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284446 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284449 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 17:37:31.291260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284452 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284455 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284458 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284461 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284464 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284470 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284473 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284477 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284480 2581 flags.go:64] FLAG: --pod-cidr="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284482 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284488 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284491 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284495 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284498 2581 flags.go:64] FLAG: --port="10250" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284501 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284503 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d58cbf357cbd353" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284507 2581 flags.go:64] FLAG: --qos-reserved="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284509 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284512 2581 flags.go:64] FLAG: --register-node="true" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284515 2581 flags.go:64] FLAG: --register-with-taints="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284518 2581 flags.go:64] FLAG: --registry-burst="10" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284521 2581 flags.go:64] FLAG: --registry-qps="5" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284523 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284526 2581 flags.go:64] FLAG: --reserved-memory="" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284530 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 17:37:31.291854 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284533 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284537 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284540 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284543 2581 flags.go:64] FLAG: --runonce="false" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284545 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284548 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284551 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284554 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284556 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284559 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284562 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284564 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284567 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284570 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284573 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284576 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284579 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284582 2581 flags.go:64] FLAG: --system-cgroups="" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284585 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284591 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284594 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284597 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284601 2581 flags.go:64] FLAG: --tls-min-version="" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284603 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284606 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 17:37:31.292847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284609 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284612 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284614 2581 flags.go:64] FLAG: --v="2" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284618 2581 flags.go:64] FLAG: --version="false" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284622 2581 flags.go:64] FLAG: --vmodule="" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284625 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.284628 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284749 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284754 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284757 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284760 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284763 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284766 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284768 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284771 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284774 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284777 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284780 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284782 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284785 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284788 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.293633 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284790 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284792 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284795 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284798 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284801 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284804 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284807 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284809 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284813 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284817 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284820 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284822 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284825 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284827 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284830 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284832 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284834 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284838 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284841 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.294171 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284845 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284848 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284851 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284853 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284855 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284858 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284860 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284863 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284865 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284868 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284870 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284872 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284875 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284877 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284880 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284882 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284885 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284887 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284891 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284893 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284896 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.294652 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284899 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284902 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284904 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284907 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284909 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284912 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284914 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284916 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284919 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284921 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284937 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284941 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284944 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284946 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284949 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284951 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284954 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284956 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284959 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284961 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.295285 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284964 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284966 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284969 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284971 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284974 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284976 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284979 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284981 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284984 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284988 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284991 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284993 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284996 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.284998 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285001 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285004 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285008 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285010 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285013 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.295757 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285016 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285019 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285021 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285024 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285028 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.285030 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.285036 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.294336 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.294353 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.294374 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.294380 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294437 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294442 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294445 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.296253 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294448 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294451 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294454 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294457 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294460 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294463 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294465 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294468 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294471 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294473 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294475 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294478 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294480 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294484 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294488 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294491 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294493 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294496 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294499 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.296591 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294502 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294505 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294508 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294510 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294513 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294515 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294518 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294520 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294523 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294526 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294528 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294531 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294534 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294536 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294539 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294541 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294544 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294546 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294549 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294552 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.297061 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294554 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294557 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294559 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294562 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294564 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294567 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294569 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294572 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294574 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294577 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294580 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294582 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294585 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294588 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294590 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294593 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294596 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294599 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294601 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294604 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.297545 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294607 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294610 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294612 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294615 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294617 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294620 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294623 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294625 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294628 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294630 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294633 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294635 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294638 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294641 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294645 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294648 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294651 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294653 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.298038 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294657 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294661 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294664 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294667 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294670 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294673 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294675 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294678 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294680 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294683 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294687 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294690 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294693 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294696 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294699 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294701 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294704 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.298536 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294707 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.294712 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294845 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294851 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294854 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294857 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294859 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294862 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294864 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294867 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294869 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294871 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294874 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294877 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294880 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 17:37:31.299010 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294884 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294888 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294891 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294893 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294895 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294898 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294901 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294904 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294906 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294908 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294911 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294914 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294916 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294919 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294922 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294941 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294944 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294948 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294950 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 17:37:31.299376 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294953 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294955 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294958 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294960 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294963 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294965 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294967 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294970 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294972 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294975 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294977 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294979 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294982 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294985 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294988 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294990 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294993 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294995 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.294997 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295000 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 17:37:31.299827 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295002 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295005 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295007 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295009 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295012 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295015 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295017 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295020 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295022 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295024 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295027 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295030 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295032 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295034 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295037 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295039 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295042 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295044 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295047 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295049 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 17:37:31.300338 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295051 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295054 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295056 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295059 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295061 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295063 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295067 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295071 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295074 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295077 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295080 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295083 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295086 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295089 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295092 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295094 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295097 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295100 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295103 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 17:37:31.300799 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295106 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295108 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295111 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295114 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295117 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295119 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295121 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:31.295124 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.295128 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.295247 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 17:37:31.301288 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.300341 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 17:37:31.301722 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.301709 2581 server.go:1019] "Starting client certificate rotation" Jun 12 17:37:31.301823 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.301808 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 17:37:31.301866 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.301857 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 17:37:31.304153 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.304141 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 17:37:31.306728 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.306713 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 17:37:31.323650 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.323629 2581 log.go:25] "Validated CRI v1 runtime API" Jun 12 17:37:31.326535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.326515 2581 log.go:25] "Validated CRI v1 image API" Jun 12 17:37:31.328044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.328028 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 17:37:31.330589 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.330562 2581 fs.go:135] Filesystem UUIDs: map[072fbb1c-d811-45db-8a4d-0243643ba7f6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 951c9a29-38ff-427b-843f-b399303585e1:/dev/nvme0n1p3] Jun 12 17:37:31.330643 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.330588 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 17:37:31.334208 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.333889 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 17:37:31.337103 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.336971 2581 manager.go:216] Machine: {Timestamp:2026-06-12 17:37:31.335475163 +0000 UTC m=+0.372660846 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117665 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ca00d4695b91cb8018f1fa955f4f7 SystemUUID:ec2ca00d-4695-b91c-b801-8f1fa955f4f7 BootID:40087ed1-49f4-489e-9c41-b3f24291be06 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:0a:71:69:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:0a:71:69:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:25:1b:59:25:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 17:37:31.337103 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.337097 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 17:37:31.337257 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.337177 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 17:37:31.340730 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.340705 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 17:37:31.340861 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.340734 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 17:37:31.341912 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.341902 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 17:37:31.341959 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.341915 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 17:37:31.341959 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.341923 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 17:37:31.341959 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.341956 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 17:37:31.343132 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.343122 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 17:37:31.346665 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346653 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 12 17:37:31.346774 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346765 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 17:37:31.346812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346794 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 12 17:37:31.346812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346804 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 17:37:31.346862 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346815 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 17:37:31.346862 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346824 2581 kubelet.go:398] "Adding apiserver pod source" Jun 12 17:37:31.346862 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.346833 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 17:37:31.349954 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.349923 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 17:37:31.350024 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.349964 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 17:37:31.353036 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.353021 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 17:37:31.353298 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.353282 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77x76" Jun 12 17:37:31.354482 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354469 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 17:37:31.354526 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354500 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 17:37:31.354663 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354653 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 17:37:31.354691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354668 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 17:37:31.354691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354675 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 17:37:31.354691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354680 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 17:37:31.354691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354688 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 17:37:31.354691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.354693 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 17:37:31.356368 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356355 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 17:37:31.356404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356369 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 17:37:31.356404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356377 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 17:37:31.356404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356382 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 17:37:31.356404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356390 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 17:37:31.356509 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.356409 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 17:37:31.357202 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.357181 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 17:37:31.357240 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.357182 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 17:37:31.358137 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.358124 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 17:37:31.358175 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.358140 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 17:37:31.361368 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.361355 2581 server.go:1268] "Started kubelet" Jun 12 17:37:31.361481 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.361449 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 17:37:31.362366 ip-10-0-129-69 systemd[1]: Started Kubernetes Kubelet. Jun 12 17:37:31.362671 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.362605 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 17:37:31.362759 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.362691 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 17:37:31.363408 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.363367 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 12 17:37:31.364191 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.364175 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 17:37:31.365354 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.365337 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77x76" Jun 12 17:37:31.366579 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.366562 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 17:37:31.368337 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.366410 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-69.ec2.internal.18b8660b4dd235ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-69.ec2.internal,UID:ip-10-0-129-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-69.ec2.internal,},FirstTimestamp:2026-06-12 17:37:31.361326538 +0000 UTC m=+0.398512225,LastTimestamp:2026-06-12 17:37:31.361326538 +0000 UTC m=+0.398512225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-69.ec2.internal,}" Jun 12 17:37:31.369101 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.369085 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 17:37:31.369201 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.369153 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 17:37:31.369260 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.369214 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.369308 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.369267 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 17:37:31.369800 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.369771 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 17:37:31.369800 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.369801 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 17:37:31.370125 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.370104 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 17:37:31.371162 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371136 2581 factory.go:55] Registering systemd factory Jun 12 17:37:31.371162 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371155 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 12 17:37:31.371290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371169 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 12 17:37:31.371290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371157 2581 factory.go:223] Registration of the systemd container factory successfully Jun 12 17:37:31.371396 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371384 2581 factory.go:153] Registering CRI-O factory Jun 12 17:37:31.371449 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371400 2581 factory.go:223] Registration of the crio container factory successfully Jun 12 17:37:31.371498 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371488 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 17:37:31.371543 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371511 2581 factory.go:103] Registering Raw factory Jun 12 17:37:31.371543 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.371533 2581 manager.go:1196] Started watching for new ooms in manager Jun 12 17:37:31.373997 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.373978 2581 manager.go:349] Starting recovery of all containers Jun 12 17:37:31.374550 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.374530 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:31.378909 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.378742 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.385186 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.385169 2581 manager.go:354] Recovery completed Jun 12 17:37:31.389356 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.389345 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.391182 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391169 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.391242 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391203 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.391242 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391214 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.391734 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391721 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.391805 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391720 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 17:37:31.391855 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391808 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 17:37:31.391855 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.391829 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 12 17:37:31.392436 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392423 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.392500 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392445 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.392500 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392454 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.392868 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392858 2581 policy_none.go:49] "None policy: Start" Jun 12 17:37:31.392904 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392872 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 17:37:31.392904 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.392882 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 17:37:31.393833 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.393823 2581 policy_none.go:47] "Start" Jun 12 17:37:31.430509 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.430493 2581 manager.go:337] "Starting Device Plugin manager" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.430532 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.430543 2581 server.go:87] "Starting device plugin registration server" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.430796 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.430806 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.431043 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.431154 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.431164 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.431851 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.431888 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.437212 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.438444 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.438476 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.438502 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.438534 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 17:37:31.450035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.440965 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:31.531481 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.531401 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.533015 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.532991 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.533138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.533024 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.533138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.533033 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.533138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.533064 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.539464 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.539446 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal"] Jun 12 17:37:31.539526 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.539517 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.540855 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.540838 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.540968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.540872 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.540968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.540885 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.541440 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.541426 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.541494 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.541444 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-69.ec2.internal\": node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.543099 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543084 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.543203 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543187 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.543249 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543220 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.543896 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543881 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.543989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543905 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.543989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543882 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.543989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543947 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.543989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543966 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.543989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.543980 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.546232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.546213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.546306 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.546245 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 17:37:31.546958 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.546918 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 12 17:37:31.547025 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.546977 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 17:37:31.547025 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.546995 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 12 17:37:31.561691 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.561675 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.571602 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.571569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.571602 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.571608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.571752 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.571627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.578626 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.578599 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.582330 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.582312 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.662015 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.661982 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.671747 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.671747 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.671943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.671943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671810 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.671943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.671943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.671851 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.763001 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.762968 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.863753 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.863679 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:31.881220 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.881195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.886084 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:31.886068 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:31.964778 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:31.964744 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:32.065330 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.065297 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:32.165878 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.165802 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:32.266594 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.266564 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 12 17:37:32.290316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.290289 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:32.301575 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.301552 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 17:37:32.301684 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.301670 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 17:37:32.301740 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.301710 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 17:37:32.301740 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.301714 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 17:37:32.348557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.347869 2581 apiserver.go:52] "Watching apiserver" Jun 12 17:37:32.364810 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.364786 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 17:37:32.365179 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.365155 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-jqc8l","openshift-network-operator/iptables-alerter-csfh7","openshift-cluster-node-tuning-operator/tuned-2k458","openshift-image-registry/node-ca-vrfdv","openshift-network-diagnostics/network-check-target-9gbss","openshift-ovn-kubernetes/ovnkube-node-q6lks","kube-system/global-pull-secret-syncer-9vjtb","kube-system/konnectivity-agent-kxnq5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f","openshift-dns/node-resolver-2h9lw","openshift-multus/multus-additional-cni-plugins-zrp2x","openshift-multus/multus-kr4lf"] Jun 12 17:37:32.367680 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.367659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.367782 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.367748 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:32.369697 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.369680 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 12 17:37:32.369797 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.369784 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 17:37:32.369853 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.369797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.370672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.370635 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 17:32:31 +0000 UTC" deadline="2027-12-09 13:29:10.642265437 +0000 UTC" Jun 12 17:37:32.370672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.370670 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13075h51m38.271597141s" Jun 12 17:37:32.371971 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.371954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.372450 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.372434 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.372450 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.372445 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 17:37:32.372579 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.372461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-26dcz\"" Jun 12 17:37:32.372579 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.372435 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.374018 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.374001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.374672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.374204 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5r2m7\"" Jun 12 17:37:32.374672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.374248 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.374672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.374258 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.376020 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376095 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-run\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376095 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-lib-modules\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376194 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llqx\" (UniqueName: \"kubernetes.io/projected/1718b725-335f-4184-b9ac-edce96f7d7db-kube-api-access-7llqx\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.376194 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-modprobe-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376194 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-sys\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-host\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-etc-tuned\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5kr\" (UniqueName: \"kubernetes.io/projected/b64bc815-8098-4953-b823-b7cbff3568c1-kube-api-access-fl5kr\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376302 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmlnf\"" Jun 12 17:37:32.376337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-conf\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtwtq\" (UniqueName: \"kubernetes.io/projected/dde20f0e-471c-44f1-87ca-259faae3c93a-kube-api-access-dtwtq\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.376476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.376476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-var-lib-kubelet\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-kubernetes\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376490 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-tmp\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376506 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-systemd\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1718b725-335f-4184-b9ac-edce96f7d7db-iptables-alerter-script\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.376746 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1718b725-335f-4184-b9ac-edce96f7d7db-host-slash\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.376746 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysconfig\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.376746 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.376710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:32.376831 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.376757 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:32.378782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.378769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.379118 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.379101 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 17:37:32.379259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.379238 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 12 17:37:32.381096 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381073 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.381187 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381110 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.381187 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381133 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 17:37:32.381291 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381240 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 17:37:32.381447 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 17:37:32.381447 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381439 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 17:37:32.381572 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.381572 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.381543 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:32.381572 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381562 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 17:37:32.381704 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.381587 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wlgtm\"" Jun 12 17:37:32.383494 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.383476 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.386502 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.386481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.387150 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.387126 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bndhf\"" Jun 12 17:37:32.387305 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.387284 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 17:37:32.387370 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.387303 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 17:37:32.388847 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.388831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.389199 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.389179 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.389282 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.389189 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.389282 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.389232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4758\"" Jun 12 17:37:32.389360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.389285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 17:37:32.389884 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.389869 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 17:37:32.391082 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.391065 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.391151 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.391131 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.391267 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.391252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pd77d\"" Jun 12 17:37:32.391321 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.391292 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.393303 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7z8lz\"" Jun 12 17:37:32.393389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393306 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 17:37:32.393389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393326 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 17:37:32.393389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393288 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 17:37:32.393389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393370 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 17:37:32.393389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.393376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 17:37:32.395604 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.395585 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal"] Jun 12 17:37:32.395681 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.395619 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal"] Jun 12 17:37:32.395774 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.395754 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.397790 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.397773 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 17:37:32.398033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.398007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rll7b\"" Jun 12 17:37:32.399388 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.399368 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rlm5r" Jun 12 17:37:32.407977 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.407917 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rlm5r" Jun 12 17:37:32.471064 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.471045 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 17:37:32.477904 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.477878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-dbus\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.477917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-system-cni-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.477962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-daemon-config\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.477984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1718b725-335f-4184-b9ac-edce96f7d7db-host-slash\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:32.478033 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-env-overrides\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-cnibin\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-system-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-cni-binary-copy\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478090 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1718b725-335f-4184-b9ac-edce96f7d7db-host-slash\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-hostroot\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kds8n\" (UniqueName: \"kubernetes.io/projected/54ab72db-d7c6-4ff3-a171-0409446c6d0c-kube-api-access-kds8n\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-var-lib-kubelet\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.478278 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-netns\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-netns\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-bin\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-netd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478318 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-var-lib-kubelet\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-config\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c891c1c-fcf1-418f-a049-46bef8baec37-hosts-file\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ac2b97a-86ca-45a1-b6f1-7844589381bd-konnectivity-ca\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-device-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-etc-kubernetes\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-systemd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-log-socket\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5kr\" (UniqueName: \"kubernetes.io/projected/b64bc815-8098-4953-b823-b7cbff3568c1-kube-api-access-fl5kr\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-systemd\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysconfig\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-lib-modules\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-systemd\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.478838 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ac2b97a-86ca-45a1-b6f1-7844589381bd-agent-certs\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-var-lib-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysconfig\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-node-log\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llqx\" (UniqueName: \"kubernetes.io/projected/1718b725-335f-4184-b9ac-edce96f7d7db-kube-api-access-7llqx\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-lib-modules\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-conf-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-multus-certs\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtwtq\" (UniqueName: \"kubernetes.io/projected/dde20f0e-471c-44f1-87ca-259faae3c93a-kube-api-access-dtwtq\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-serviceca\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tdvq\" (UniqueName: \"kubernetes.io/projected/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-kube-api-access-4tdvq\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-etc-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.478993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-tmp\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-os-release\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.479689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-kubelet\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-etc-tuned\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-run\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-bin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-host\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-slash\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-ovn\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovn-node-metrics-cert\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-kubelet-config\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479311 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-conf\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c891c1c-fcf1-418f-a049-46bef8baec37-tmp-dir\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.480764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-k8s-cni-cncf-io\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-kubernetes\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8knv\" (UniqueName: \"kubernetes.io/projected/2c891c1c-fcf1-418f-a049-46bef8baec37-kube-api-access-c8knv\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-kubernetes\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.479689 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-sysctl-conf\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.479783 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:37:32.979748132 +0000 UTC m=+2.016933818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479803 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-run\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-systemd-units\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-host\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.479970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-host\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1718b725-335f-4184-b9ac-edce96f7d7db-iptables-alerter-script\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52lj\" (UniqueName: \"kubernetes.io/projected/ed4cfb3f-637d-48ee-99ca-60061877139d-kube-api-access-w52lj\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.481266 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-cnibin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-multus\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-kubelet\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-script-lib\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-modprobe-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-sys\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qlj2\" (UniqueName: \"kubernetes.io/projected/c524fb98-712b-454a-b216-7ec9134b31e1-kube-api-access-6qlj2\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-etc-modprobe-d\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-socket-dir-parent\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64bc815-8098-4953-b823-b7cbff3568c1-sys\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-os-release\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdw9\" (UniqueName: \"kubernetes.io/projected/d11027cf-bc8c-4db8-b85c-1746114ec075-kube-api-access-4hdw9\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.481782 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.480553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1718b725-335f-4184-b9ac-edce96f7d7db-iptables-alerter-script\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.482391 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.482323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-tmp\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.482436 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.482421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64bc815-8098-4953-b823-b7cbff3568c1-etc-tuned\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.487652 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.487632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtwtq\" (UniqueName: \"kubernetes.io/projected/dde20f0e-471c-44f1-87ca-259faae3c93a-kube-api-access-dtwtq\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.487993 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.487972 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llqx\" (UniqueName: \"kubernetes.io/projected/1718b725-335f-4184-b9ac-edce96f7d7db-kube-api-access-7llqx\") pod \"iptables-alerter-csfh7\" (UID: \"1718b725-335f-4184-b9ac-edce96f7d7db\") " pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.490900 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.490845 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23273554850e38b11c948ea91c43bdb5.slice/crio-ebf619843573b76af6aba99e434424ff45e311abc6eb5c656ccd8945c50d858a WatchSource:0}: Error finding container ebf619843573b76af6aba99e434424ff45e311abc6eb5c656ccd8945c50d858a: Status 404 returned error can't find the container with id ebf619843573b76af6aba99e434424ff45e311abc6eb5c656ccd8945c50d858a Jun 12 17:37:32.491546 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.491524 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cc1eeeda5c676493db83fa5936c2f7.slice/crio-4785b3ff1c500690adffc42f6a96701c26391315e21ccde4d841b035b1d310fd WatchSource:0}: Error finding container 4785b3ff1c500690adffc42f6a96701c26391315e21ccde4d841b035b1d310fd: Status 404 returned error can't find the container with id 4785b3ff1c500690adffc42f6a96701c26391315e21ccde4d841b035b1d310fd Jun 12 17:37:32.492721 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.492702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5kr\" (UniqueName: \"kubernetes.io/projected/b64bc815-8098-4953-b823-b7cbff3568c1-kube-api-access-fl5kr\") pod \"tuned-2k458\" (UID: \"b64bc815-8098-4953-b823-b7cbff3568c1\") " pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.496304 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.496291 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 17:37:32.551684 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.551657 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:32.581309 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ac2b97a-86ca-45a1-b6f1-7844589381bd-agent-certs\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.581309 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-var-lib-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-node-log\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-conf-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-node-log\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-var-lib-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-conf-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-multus-certs\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.581471 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-serviceca\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.581525 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.581532 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:33.081510315 +0000 UTC m=+2.118695989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tdvq\" (UniqueName: \"kubernetes.io/projected/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-kube-api-access-4tdvq\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-etc-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-multus-certs\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581676 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-os-release\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-kubelet\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-os-release\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-etc-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-kubelet\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-bin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-host\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.581948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581835 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-bin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-slash\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581860 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-slash\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-ovn\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581896 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-serviceca\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581913 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-ovn\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovn-node-metrics-cert\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.581888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-host\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-kubelet-config\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582066 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-kubelet-config\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c891c1c-fcf1-418f-a049-46bef8baec37-tmp-dir\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.582691 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-k8s-cni-cncf-io\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-k8s-cni-cncf-io\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8knv\" (UniqueName: \"kubernetes.io/projected/2c891c1c-fcf1-418f-a049-46bef8baec37-kube-api-access-c8knv\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-systemd-units\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582300 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-openvswitch\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52lj\" (UniqueName: \"kubernetes.io/projected/ed4cfb3f-637d-48ee-99ca-60061877139d-kube-api-access-w52lj\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-cnibin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-multus\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c891c1c-fcf1-418f-a049-46bef8baec37-tmp-dir\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-kubelet\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-script-lib\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qlj2\" (UniqueName: \"kubernetes.io/projected/c524fb98-712b-454a-b216-7ec9134b31e1-kube-api-access-6qlj2\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.583504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-kubelet\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-socket-dir-parent\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582586 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-cnibin\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-os-release\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdw9\" (UniqueName: \"kubernetes.io/projected/d11027cf-bc8c-4db8-b85c-1746114ec075-kube-api-access-4hdw9\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-dbus\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-system-cni-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-daemon-config\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-var-lib-cni-multus\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-env-overrides\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-cnibin\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-system-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-cni-binary-copy\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-systemd-units\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583008 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-hostroot\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-socket-dir-parent\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.582971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-hostroot\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kds8n\" (UniqueName: \"kubernetes.io/projected/54ab72db-d7c6-4ff3-a171-0409446c6d0c-kube-api-access-kds8n\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-os-release\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-system-cni-dir\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-cnibin\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed4cfb3f-637d-48ee-99ca-60061877139d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-env-overrides\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-multus-daemon-config\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-netns\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-netns\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-bin\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-netd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-config\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c891c1c-fcf1-418f-a049-46bef8baec37-hosts-file\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.584766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-run-netns\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ac2b97a-86ca-45a1-b6f1-7844589381bd-konnectivity-ca\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-device-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c891c1c-fcf1-418f-a049-46bef8baec37-hosts-file\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-etc-kubernetes\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583575 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583567 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4cfb3f-637d-48ee-99ca-60061877139d-system-cni-dir\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc1a2667-2314-4331-a789-b42dddd53616-dbus\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-systemd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-host-run-netns\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-run-systemd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-netd\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d11027cf-bc8c-4db8-b85c-1746114ec075-cni-binary-copy\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c524fb98-712b-454a-b216-7ec9134b31e1-device-dir\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-log-socket\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d11027cf-bc8c-4db8-b85c-1746114ec075-etc-kubernetes\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583694 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-log-socket\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585259 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ab72db-d7c6-4ff3-a171-0409446c6d0c-host-cni-bin\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.583990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-script-lib\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.584032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovnkube-config\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.584227 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ac2b97a-86ca-45a1-b6f1-7844589381bd-konnectivity-ca\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.585749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.584510 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ab72db-d7c6-4ff3-a171-0409446c6d0c-ovn-node-metrics-cert\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.585749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.584522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ac2b97a-86ca-45a1-b6f1-7844589381bd-agent-certs\") pod \"konnectivity-agent-kxnq5\" (UID: \"5ac2b97a-86ca-45a1-b6f1-7844589381bd\") " pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.591226 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.591202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tdvq\" (UniqueName: \"kubernetes.io/projected/f5f2d5bf-ca7b-486a-89ab-abfebf500d5b-kube-api-access-4tdvq\") pod \"node-ca-vrfdv\" (UID: \"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b\") " pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.592487 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.592461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8knv\" (UniqueName: \"kubernetes.io/projected/2c891c1c-fcf1-418f-a049-46bef8baec37-kube-api-access-c8knv\") pod \"node-resolver-2h9lw\" (UID: \"2c891c1c-fcf1-418f-a049-46bef8baec37\") " pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.592806 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.592786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kds8n\" (UniqueName: \"kubernetes.io/projected/54ab72db-d7c6-4ff3-a171-0409446c6d0c-kube-api-access-kds8n\") pod \"ovnkube-node-q6lks\" (UID: \"54ab72db-d7c6-4ff3-a171-0409446c6d0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.593113 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.593095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qlj2\" (UniqueName: \"kubernetes.io/projected/c524fb98-712b-454a-b216-7ec9134b31e1-kube-api-access-6qlj2\") pod \"aws-ebs-csi-driver-node-4b87f\" (UID: \"c524fb98-712b-454a-b216-7ec9134b31e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.593228 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.593215 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:32.593265 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.593232 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:32.593265 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.593241 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:32.593322 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.593285 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:33.093273612 +0000 UTC m=+2.130459283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:32.593413 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.593393 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdw9\" (UniqueName: \"kubernetes.io/projected/d11027cf-bc8c-4db8-b85c-1746114ec075-kube-api-access-4hdw9\") pod \"multus-kr4lf\" (UID: \"d11027cf-bc8c-4db8-b85c-1746114ec075\") " pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.594360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.594344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52lj\" (UniqueName: \"kubernetes.io/projected/ed4cfb3f-637d-48ee-99ca-60061877139d-kube-api-access-w52lj\") pod \"multus-additional-cni-plugins-zrp2x\" (UID: \"ed4cfb3f-637d-48ee-99ca-60061877139d\") " pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.696900 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.696823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csfh7" Jun 12 17:37:32.700915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.700892 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2k458" Jun 12 17:37:32.707491 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.707465 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1718b725_335f_4184_b9ac_edce96f7d7db.slice/crio-cbf542fe478564f81a4fbe63f575545c3c6ec58ac1fc6da72042d8582a7ec3d7 WatchSource:0}: Error finding container cbf542fe478564f81a4fbe63f575545c3c6ec58ac1fc6da72042d8582a7ec3d7: Status 404 returned error can't find the container with id cbf542fe478564f81a4fbe63f575545c3c6ec58ac1fc6da72042d8582a7ec3d7 Jun 12 17:37:32.709342 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.709270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64bc815_8098_4953_b823_b7cbff3568c1.slice/crio-375efbc53d6abd0e93bdf7270ca8a8d691c176c11807ee78aa97531ccfa8fdfb WatchSource:0}: Error finding container 375efbc53d6abd0e93bdf7270ca8a8d691c176c11807ee78aa97531ccfa8fdfb: Status 404 returned error can't find the container with id 375efbc53d6abd0e93bdf7270ca8a8d691c176c11807ee78aa97531ccfa8fdfb Jun 12 17:37:32.718323 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.718305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrfdv" Jun 12 17:37:32.728435 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.728412 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f2d5bf_ca7b_486a_89ab_abfebf500d5b.slice/crio-108eeca485691280ac28c61bcdc3577f9ff8f2f72f81fbc49918c2b667d98e1f WatchSource:0}: Error finding container 108eeca485691280ac28c61bcdc3577f9ff8f2f72f81fbc49918c2b667d98e1f: Status 404 returned error can't find the container with id 108eeca485691280ac28c61bcdc3577f9ff8f2f72f81fbc49918c2b667d98e1f Jun 12 17:37:32.737598 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.737579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:32.745234 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.745213 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ab72db_d7c6_4ff3_a171_0409446c6d0c.slice/crio-9daec5c3b8a151b1d0f50258aaeca2ae92a864cd0d37b8dfb9cfb0acf8890059 WatchSource:0}: Error finding container 9daec5c3b8a151b1d0f50258aaeca2ae92a864cd0d37b8dfb9cfb0acf8890059: Status 404 returned error can't find the container with id 9daec5c3b8a151b1d0f50258aaeca2ae92a864cd0d37b8dfb9cfb0acf8890059 Jun 12 17:37:32.760784 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.760765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:32.768385 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.768366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac2b97a_86ca_45a1_b6f1_7844589381bd.slice/crio-216c899c3ac12317765dd3efe9b3b03e552c94379ae4af1b3897adcb4d29a0d0 WatchSource:0}: Error finding container 216c899c3ac12317765dd3efe9b3b03e552c94379ae4af1b3897adcb4d29a0d0: Status 404 returned error can't find the container with id 216c899c3ac12317765dd3efe9b3b03e552c94379ae4af1b3897adcb4d29a0d0 Jun 12 17:37:32.776015 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.775998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" Jun 12 17:37:32.784324 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.784304 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc524fb98_712b_454a_b216_7ec9134b31e1.slice/crio-d0bcf5ef4b813ab258976038aa6527be6feaaa53d55ceaf0a75518b05644bb62 WatchSource:0}: Error finding container d0bcf5ef4b813ab258976038aa6527be6feaaa53d55ceaf0a75518b05644bb62: Status 404 returned error can't find the container with id d0bcf5ef4b813ab258976038aa6527be6feaaa53d55ceaf0a75518b05644bb62 Jun 12 17:37:32.789405 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.789376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h9lw" Jun 12 17:37:32.795829 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.795814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" Jun 12 17:37:32.797508 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.797487 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c891c1c_fcf1_418f_a049_46bef8baec37.slice/crio-89d4f518daba985ec5f052bd90f2540ee452bdab1906732e7f7700ce626f1d3b WatchSource:0}: Error finding container 89d4f518daba985ec5f052bd90f2540ee452bdab1906732e7f7700ce626f1d3b: Status 404 returned error can't find the container with id 89d4f518daba985ec5f052bd90f2540ee452bdab1906732e7f7700ce626f1d3b Jun 12 17:37:32.803535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.803519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kr4lf" Jun 12 17:37:32.804733 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.804713 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4cfb3f_637d_48ee_99ca_60061877139d.slice/crio-3589a136d5b5d3a03c95d943bd40c62c396b0c762d75311de124df5de21c45a8 WatchSource:0}: Error finding container 3589a136d5b5d3a03c95d943bd40c62c396b0c762d75311de124df5de21c45a8: Status 404 returned error can't find the container with id 3589a136d5b5d3a03c95d943bd40c62c396b0c762d75311de124df5de21c45a8 Jun 12 17:37:32.812191 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:37:32.812171 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11027cf_bc8c_4db8_b85c_1746114ec075.slice/crio-77fc4eb7ee518c9c60114d6afc5f4e4aa191a553d846c990e69d1f400230b8e0 WatchSource:0}: Error finding container 77fc4eb7ee518c9c60114d6afc5f4e4aa191a553d846c990e69d1f400230b8e0: Status 404 returned error can't find the container with id 77fc4eb7ee518c9c60114d6afc5f4e4aa191a553d846c990e69d1f400230b8e0 Jun 12 17:37:32.986552 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:32.986479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:32.986692 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.986632 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:32.986732 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:32.986702 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:37:33.986682082 +0000 UTC m=+3.023867771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:33.087834 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.087216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:33.087834 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.087414 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:33.087834 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.087471 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:34.087453414 +0000 UTC m=+3.124639104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:33.189162 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.188516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:33.189162 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.188730 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:33.189162 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.188748 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:33.189162 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.188759 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:33.189162 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.188815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:34.188794543 +0000 UTC m=+3.225980218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:33.322971 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.322564 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:33.410749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.410692 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 17:32:32 +0000 UTC" deadline="2028-01-27 16:14:46.623888552 +0000 UTC" Jun 12 17:37:33.410749 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.410747 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14254h37m13.213145319s" Jun 12 17:37:33.480363 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.480265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kr4lf" event={"ID":"d11027cf-bc8c-4db8-b85c-1746114ec075","Type":"ContainerStarted","Data":"77fc4eb7ee518c9c60114d6afc5f4e4aa191a553d846c990e69d1f400230b8e0"} Jun 12 17:37:33.483178 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.482655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h9lw" event={"ID":"2c891c1c-fcf1-418f-a049-46bef8baec37","Type":"ContainerStarted","Data":"89d4f518daba985ec5f052bd90f2540ee452bdab1906732e7f7700ce626f1d3b"} Jun 12 17:37:33.487294 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.487266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxnq5" event={"ID":"5ac2b97a-86ca-45a1-b6f1-7844589381bd","Type":"ContainerStarted","Data":"216c899c3ac12317765dd3efe9b3b03e552c94379ae4af1b3897adcb4d29a0d0"} Jun 12 17:37:33.497149 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.497105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerStarted","Data":"ebf619843573b76af6aba99e434424ff45e311abc6eb5c656ccd8945c50d858a"} Jun 12 17:37:33.501408 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.501380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" event={"ID":"e6cc1eeeda5c676493db83fa5936c2f7","Type":"ContainerStarted","Data":"4785b3ff1c500690adffc42f6a96701c26391315e21ccde4d841b035b1d310fd"} Jun 12 17:37:33.511215 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.510208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerStarted","Data":"3589a136d5b5d3a03c95d943bd40c62c396b0c762d75311de124df5de21c45a8"} Jun 12 17:37:33.512685 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.512658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" event={"ID":"c524fb98-712b-454a-b216-7ec9134b31e1","Type":"ContainerStarted","Data":"d0bcf5ef4b813ab258976038aa6527be6feaaa53d55ceaf0a75518b05644bb62"} Jun 12 17:37:33.514321 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.514284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"9daec5c3b8a151b1d0f50258aaeca2ae92a864cd0d37b8dfb9cfb0acf8890059"} Jun 12 17:37:33.528107 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.527913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrfdv" event={"ID":"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b","Type":"ContainerStarted","Data":"108eeca485691280ac28c61bcdc3577f9ff8f2f72f81fbc49918c2b667d98e1f"} Jun 12 17:37:33.542665 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.542606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2k458" event={"ID":"b64bc815-8098-4953-b823-b7cbff3568c1","Type":"ContainerStarted","Data":"375efbc53d6abd0e93bdf7270ca8a8d691c176c11807ee78aa97531ccfa8fdfb"} Jun 12 17:37:33.548182 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.548154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csfh7" event={"ID":"1718b725-335f-4184-b9ac-edce96f7d7db","Type":"ContainerStarted","Data":"cbf542fe478564f81a4fbe63f575545c3c6ec58ac1fc6da72042d8582a7ec3d7"} Jun 12 17:37:33.736058 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.732030 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:33.995870 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:33.995790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:33.996120 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.995959 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:33.996120 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:33.996024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:37:35.996005014 +0000 UTC m=+5.033190686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:34.097067 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.097030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:34.097230 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.097204 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:34.097349 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.097270 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:36.097250524 +0000 UTC m=+5.134436208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:34.198333 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.198299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:34.198564 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.198452 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:34.198564 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.198474 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:34.198564 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.198488 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:34.198564 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.198547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:36.198529151 +0000 UTC m=+5.235714827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:34.411595 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.411512 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 17:32:32 +0000 UTC" deadline="2028-01-21 14:31:34.377758327 +0000 UTC" Jun 12 17:37:34.411595 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.411552 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14108h53m59.966210975s" Jun 12 17:37:34.439637 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.439601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:34.439802 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.439728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:34.440267 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.440138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:34.440267 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.440227 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:34.440424 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:34.440289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:34.440424 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:34.440368 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:35.265485 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:35.265454 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 17:37:36.015791 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.015759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:36.016282 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.015902 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:36.016282 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.015987 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:37:40.015966712 +0000 UTC m=+9.053152583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:36.117283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.116604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:36.117283 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.116823 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:36.117283 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.116888 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:40.116869146 +0000 UTC m=+9.154054819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:36.217948 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.217324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:36.217948 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.217501 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:36.217948 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.217535 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:36.217948 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.217548 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:36.217948 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.217607 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:40.217594681 +0000 UTC m=+9.254780351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:36.439281 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.439199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:36.439431 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.439320 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:36.439703 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.439675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:36.439787 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.439769 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:36.439885 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:36.439823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:36.439971 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:36.439908 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:38.439620 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:38.439556 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:38.439996 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:38.439697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:38.439996 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:38.439701 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:38.439996 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:38.439733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:38.439996 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:38.439827 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:38.439996 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:38.439902 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:40.052094 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.052061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:40.052489 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.052245 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:40.052489 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.052301 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:37:48.052286468 +0000 UTC m=+17.089472138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:40.152630 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.152596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:40.152804 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.152759 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:40.152868 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.152832 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:48.152810921 +0000 UTC m=+17.189996592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:40.253383 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.253340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:40.253578 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.253534 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:40.253578 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.253558 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:40.253578 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.253572 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:40.253732 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.253632 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:37:48.253615409 +0000 UTC m=+17.290801096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:40.439292 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.439260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:40.439454 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.439383 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:40.439755 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.439731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:40.439873 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.439852 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:40.439917 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:40.439907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:40.440029 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:40.440003 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:42.439475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:42.439605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:42.439475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:42.439708 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:42.439475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:42.439964 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:42.439779 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:44.439411 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:44.439198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:44.439799 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:44.439264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:44.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:44.439495 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:44.439799 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:44.439267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:44.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:44.439558 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:44.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:44.439671 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:46.439355 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:46.439317 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:46.439799 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:46.439439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:46.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:46.439450 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:46.439799 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:46.439468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:46.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:46.439548 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:46.439799 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:46.439646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:48.111220 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.111190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:48.111696 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.111348 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:48.111696 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.111433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:38:04.111392679 +0000 UTC m=+33.148578367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:37:48.211981 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.211943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:48.212145 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.212091 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:48.212199 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.212163 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:38:04.212142856 +0000 UTC m=+33.249328541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:37:48.312422 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.312385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:48.312600 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.312540 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:37:48.312600 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.312559 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:37:48.312600 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.312572 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:48.312769 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.312633 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:38:04.312614682 +0000 UTC m=+33.349800355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:37:48.439276 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.439242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:48.439276 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.439266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:48.439551 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:48.439253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:48.439551 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.439385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:48.439551 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.439470 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:48.439551 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:48.439539 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:50.439367 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:50.439330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:50.439837 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:50.439379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:50.439837 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:50.439443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:50.439837 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:50.439461 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:50.439837 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:50.439540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:50.439837 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:50.439638 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:52.439478 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:52.439438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:52.439478 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:52.439467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:52.440026 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:52.439560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:52.440026 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:52.439577 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:52.440026 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:52.439645 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:52.440026 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:52.439772 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:54.439677 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.439654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:54.440234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.439675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:54.440234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.439663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:54.440234 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:54.439747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:54.440234 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:54.439832 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:54.440234 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:54.439908 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:54.600821 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.600795 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:37:54.601171 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601152 2581 generic.go:356] "Generic (PLEG): container finished" podID="54ab72db-d7c6-4ff3-a171-0409446c6d0c" containerID="e860653e35d34996875c4080db52e4a6c33ecefade0086c952ed1c2bdacb1688" exitCode=1 Jun 12 17:37:54.601279 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"940a51819738ce2c3cb435c692676cde752f4cee5dd57830ab18eeb00c0e6f24"} Jun 12 17:37:54.601345 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601285 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"e3a233571ba2e3f6668c82526a568e199b16ec04d0e0600b0f45f4d46c901c9d"} Jun 12 17:37:54.601345 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"2b3c5f18921b8a53b4e4c882e6cca16fa5407486926621746939471476a54bb6"} Jun 12 17:37:54.601429 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerDied","Data":"e860653e35d34996875c4080db52e4a6c33ecefade0086c952ed1c2bdacb1688"} Jun 12 17:37:54.601429 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.601381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"485d8bb911296d3d8b0a79d08c9ef2db23541302e7026382cbd5c289fb0066da"} Jun 12 17:37:54.602530 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.602500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2k458" event={"ID":"b64bc815-8098-4953-b823-b7cbff3568c1","Type":"ContainerStarted","Data":"e03a9e8df52f0436b39c99ebf84cf29fb9833a982c1d662a9988b4f51a2b85c5"} Jun 12 17:37:54.603742 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.603723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kr4lf" event={"ID":"d11027cf-bc8c-4db8-b85c-1746114ec075","Type":"ContainerStarted","Data":"ab2027a041ffe3caf528f603ded92ec641b055af09b72a6b21a162e3c93474a5"} Jun 12 17:37:54.604902 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.604883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" event={"ID":"e6cc1eeeda5c676493db83fa5936c2f7","Type":"ContainerStarted","Data":"0c1ae598866b3c95b40c5cdeb4816904fb5dcf0680cb6ee95d9d2bfacae80825"} Jun 12 17:37:54.621419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.621348 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2k458" podStartSLOduration=2.766212517 podStartE2EDuration="23.621335025s" totalImagesPullingTime="20.855122508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:54.620852846 +0000 UTC m=+23.658038552" watchObservedRunningTime="2026-06-12 17:37:54.621335025 +0000 UTC m=+23.658520718" Jun 12 17:37:54.639138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.639102 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kr4lf" podStartSLOduration=2.853411262 podStartE2EDuration="23.639090887s" totalImagesPullingTime="20.785679625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:54.6389991 +0000 UTC m=+23.676184793" watchObservedRunningTime="2026-06-12 17:37:54.639090887 +0000 UTC m=+23.676276580" Jun 12 17:37:54.653089 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:54.653051 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" podStartSLOduration=22.653040284 podStartE2EDuration="22.653040284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:54.652650794 +0000 UTC m=+23.689836488" watchObservedRunningTime="2026-06-12 17:37:54.653040284 +0000 UTC m=+23.690225978" Jun 12 17:37:55.608158 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.607911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrfdv" event={"ID":"f5f2d5bf-ca7b-486a-89ab-abfebf500d5b","Type":"ContainerStarted","Data":"441c5b3ab9d7f0a586f0f6f00717c08346bab5e4e9e1c3d71afc4a3902c0c3ec"} Jun 12 17:37:55.609456 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.609425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csfh7" event={"ID":"1718b725-335f-4184-b9ac-edce96f7d7db","Type":"ContainerStarted","Data":"e61f80f836850c4db18c6c6352df9a280c8a598764ea96afae626261b82036a9"} Jun 12 17:37:55.610943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.610902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h9lw" event={"ID":"2c891c1c-fcf1-418f-a049-46bef8baec37","Type":"ContainerStarted","Data":"5b4890a064e1be6f440f4b79f7c4cfc7e2467a2e0608812abac8163661c7d6e8"} Jun 12 17:37:55.612512 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.612491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxnq5" event={"ID":"5ac2b97a-86ca-45a1-b6f1-7844589381bd","Type":"ContainerStarted","Data":"e3c466c0881aaf6b2100c9328a7effd3a64dcf08bf884f9b73aacad4f0599719"} Jun 12 17:37:55.613898 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.613875 2581 generic.go:356] "Generic (PLEG): container finished" podID="23273554850e38b11c948ea91c43bdb5" containerID="4dca031191cb63872e558a24c1d9ee28b87c788ec1d824c11a2c56e538ef2f17" exitCode=0 Jun 12 17:37:55.614023 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.613907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerDied","Data":"4dca031191cb63872e558a24c1d9ee28b87c788ec1d824c11a2c56e538ef2f17"} Jun 12 17:37:55.615613 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.615591 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="2d94b3b2660f69723831124538104896f2989e7c2f9b20be4b341dab1d9bd9b9" exitCode=0 Jun 12 17:37:55.615683 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.615669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"2d94b3b2660f69723831124538104896f2989e7c2f9b20be4b341dab1d9bd9b9"} Jun 12 17:37:55.617176 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.617158 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" event={"ID":"c524fb98-712b-454a-b216-7ec9134b31e1","Type":"ContainerStarted","Data":"6594d59d429c419a264b2e5448789107d182ebc5856656da177eccd7c1c02cba"} Jun 12 17:37:55.620216 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.620199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:37:55.620634 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.620560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"4c441ff4b72684bacb232dc0778151dffe17fd8496946016a5eb27da5ff8c3db"} Jun 12 17:37:55.623262 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.623229 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vrfdv" podStartSLOduration=3.879751792 podStartE2EDuration="24.623218304s" totalImagesPullingTime="20.743466512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:55.623048965 +0000 UTC m=+24.660234659" watchObservedRunningTime="2026-06-12 17:37:55.623218304 +0000 UTC m=+24.660403996" Jun 12 17:37:55.641769 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.641722 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxnq5" podStartSLOduration=12.499186487 podStartE2EDuration="24.641703944s" totalImagesPullingTime="12.142517457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:55.641053473 +0000 UTC m=+24.678239164" watchObservedRunningTime="2026-06-12 17:37:55.641703944 +0000 UTC m=+24.678889638" Jun 12 17:37:55.661521 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.661471 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2h9lw" podStartSLOduration=3.986421275 podStartE2EDuration="24.661455363s" totalImagesPullingTime="20.675034088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:55.661001136 +0000 UTC m=+24.698186828" watchObservedRunningTime="2026-06-12 17:37:55.661455363 +0000 UTC m=+24.698641055" Jun 12 17:37:55.719879 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:55.719832 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-csfh7" podStartSLOduration=3.886232922 podStartE2EDuration="24.71981804s" totalImagesPullingTime="20.833585118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:55.71952788 +0000 UTC m=+24.756713586" watchObservedRunningTime="2026-06-12 17:37:55.71981804 +0000 UTC m=+24.757003732" Jun 12 17:37:56.186372 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.186353 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 17:37:56.439682 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.439655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:56.439892 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.439737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:56.439892 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:56.439746 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:56.439892 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:56.439819 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:56.439892 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.439849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:56.440051 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:56.439906 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:56.440693 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.440631 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T17:37:56.186370821Z","UUID":"8a8aa633-1177-441a-bac8-8ca920f7297f","Handler":null,"Name":"","Endpoint":""} Jun 12 17:37:56.442117 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.442093 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 17:37:56.442180 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.442126 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 17:37:56.630354 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.629878 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerStarted","Data":"698d4a77445549f91110b1e5e3220860a39bd0f17468401ae9fb65f80f7396c6"} Jun 12 17:37:56.632094 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:56.632061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" event={"ID":"c524fb98-712b-454a-b216-7ec9134b31e1","Type":"ContainerStarted","Data":"8817e04c4d4ba7857a037d5b415fde1b26d6ef53e69e1ed548e69ac7b5376116"} Jun 12 17:37:57.636787 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:57.636702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" event={"ID":"c524fb98-712b-454a-b216-7ec9134b31e1","Type":"ContainerStarted","Data":"35007d751f6d476f37e2692f495caa295d69961c32fcb8ad27020a54fda2b1d0"} Jun 12 17:37:57.640564 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:57.640542 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:37:57.640994 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:57.640970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"e0433298740363e1ef0beb4d16708e8596a638825dc059b5fce7dab4ec0ac17e"} Jun 12 17:37:57.659080 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:57.659031 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" podStartSLOduration=25.659011454 podStartE2EDuration="25.659011454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:56.645968118 +0000 UTC m=+25.683153871" watchObservedRunningTime="2026-06-12 17:37:57.659011454 +0000 UTC m=+26.696197150" Jun 12 17:37:57.659275 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:57.659229 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b87f" podStartSLOduration=3.81424118 podStartE2EDuration="26.659222379s" totalImagesPullingTime="22.844981199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:37:57.658196316 +0000 UTC m=+26.695382009" watchObservedRunningTime="2026-06-12 17:37:57.659222379 +0000 UTC m=+26.696408072" Jun 12 17:37:58.439083 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:58.439049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:37:58.439083 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:58.439083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:37:58.439330 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:58.439049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:37:58.439330 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:58.439191 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:37:58.439330 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:58.439286 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:37:58.439465 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:37:58.439350 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:37:58.499180 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:58.499146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:58.499785 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:58.499747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:59.649078 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.648841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:37:59.649802 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.649475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"3eff8258c95e1ef2aabf270005628c9ee80b1bebfbace21effb775f0fc99ad1e"} Jun 12 17:37:59.649863 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.649834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:59.650086 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.650070 2581 scope.go:117] "RemoveContainer" containerID="e860653e35d34996875c4080db52e4a6c33ecefade0086c952ed1c2bdacb1688" Jun 12 17:37:59.666706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.666682 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:37:59.837414 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.837381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:59.837626 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.837509 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 17:37:59.838020 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.837992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxnq5" Jun 12 17:37:59.951636 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:37:59.951608 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:38:00.438794 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:00.438747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:00.439095 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:00.438876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:00.439095 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:00.438889 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:00.439095 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:00.438881 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:38:00.439095 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:00.439008 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:38:00.439281 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:00.439093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:38:01.294297 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.294085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vjtb"] Jun 12 17:38:01.294722 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.294368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:01.294722 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:01.294450 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:38:01.297256 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.297232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gbss"] Jun 12 17:38:01.297396 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.297328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:01.297444 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:01.297406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:38:01.297883 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.297851 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqc8l"] Jun 12 17:38:01.297983 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.297962 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:01.298055 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:01.298038 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:38:01.655463 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.655383 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="2eb9c452edb2dffab39d2137a466bbc8f85dfc02d2169ae2ba2733361f12695c" exitCode=0 Jun 12 17:38:01.655634 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.655473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"2eb9c452edb2dffab39d2137a466bbc8f85dfc02d2169ae2ba2733361f12695c"} Jun 12 17:38:01.659212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.659194 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:38:01.659588 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.659557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" event={"ID":"54ab72db-d7c6-4ff3-a171-0409446c6d0c","Type":"ContainerStarted","Data":"7bed405dd42642ba64634f376056bdbd02d27f82e66bcc49d7274aa1894d1381"} Jun 12 17:38:01.659777 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.659764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:38:01.676426 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.676403 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:38:01.729361 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:01.729307 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" podStartSLOduration=9.45940184 podStartE2EDuration="30.729270378s" totalImagesPullingTime="21.269868538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:38:01.728807562 +0000 UTC m=+30.765993254" watchObservedRunningTime="2026-06-12 17:38:01.729270378 +0000 UTC m=+30.766456256" Jun 12 17:38:02.439038 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:02.439001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:02.439427 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:02.439113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:38:03.439612 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:03.439587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:03.439988 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:03.439594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:03.439988 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:03.439690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:38:03.439988 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:03.439758 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:38:03.666275 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:03.666242 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="cff4f4b48b64bb3ec05ad7802f2975cd74d8aba76ddd5c9679fadb1bea9943d1" exitCode=0 Jun 12 17:38:03.666455 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:03.666314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"cff4f4b48b64bb3ec05ad7802f2975cd74d8aba76ddd5c9679fadb1bea9943d1"} Jun 12 17:38:03.680469 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:03.680294 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" podUID="54ab72db-d7c6-4ff3-a171-0409446c6d0c" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 17:38:04.134859 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:04.134780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:04.135019 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.134881 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:38:04.135019 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.134956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:38:36.134921233 +0000 UTC m=+65.172106903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 17:38:04.235297 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:04.235264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:04.235452 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.235369 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 17:38:04.235452 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.235419 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret podName:dc1a2667-2314-4331-a789-b42dddd53616 nodeName:}" failed. No retries permitted until 2026-06-12 17:38:36.235406222 +0000 UTC m=+65.272591894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret") pod "global-pull-secret-syncer-9vjtb" (UID: "dc1a2667-2314-4331-a789-b42dddd53616") : object "kube-system"/"original-pull-secret" not registered Jun 12 17:38:04.336232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:04.336202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:04.336418 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.336391 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 17:38:04.336418 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.336415 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 17:38:04.336596 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.336427 2581 projected.go:196] Error preparing data for projected volume kube-api-access-brcvb for pod openshift-network-diagnostics/network-check-target-9gbss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:38:04.336596 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.336487 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb podName:868e2e9e-39a1-4009-a29a-ad389c9087a5 nodeName:}" failed. No retries permitted until 2026-06-12 17:38:36.336474029 +0000 UTC m=+65.373659700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-brcvb" (UniqueName: "kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb") pod "network-check-target-9gbss" (UID: "868e2e9e-39a1-4009-a29a-ad389c9087a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 17:38:04.438808 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:04.438781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:04.438973 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:04.438882 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:38:05.442230 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:05.442204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:05.442584 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:05.442314 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:38:05.442584 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:05.442363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:05.442584 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:05.442446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vjtb" podUID="dc1a2667-2314-4331-a789-b42dddd53616" Jun 12 17:38:05.673834 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:05.673805 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="a49fcefa7178a90d2663527b437c455038977164c284d2385a6770ba5ae5d532" exitCode=0 Jun 12 17:38:05.674014 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:05.673855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"a49fcefa7178a90d2663527b437c455038977164c284d2385a6770ba5ae5d532"} Jun 12 17:38:06.439568 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.439541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:06.439733 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:06.439646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gbss" podUID="868e2e9e-39a1-4009-a29a-ad389c9087a5" Jun 12 17:38:06.708629 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.708595 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeReady" Jun 12 17:38:06.709215 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.708755 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 17:38:06.751003 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.750965 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7lnsw"] Jun 12 17:38:06.752842 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.752818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.754171 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.754148 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kl9ks"] Jun 12 17:38:06.755577 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.755561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.757638 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.757617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 17:38:06.757971 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.757916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 17:38:06.758077 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.757923 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 17:38:06.758077 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.757995 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7sb6x\"" Jun 12 17:38:06.758077 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.758058 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9gcml\"" Jun 12 17:38:06.758195 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.758135 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 17:38:06.758738 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.758718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 17:38:06.765611 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.764497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lnsw"] Jun 12 17:38:06.769830 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.769807 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kl9ks"] Jun 12 17:38:06.853049 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.853234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-cert\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.853234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gh6f\" (UniqueName: \"kubernetes.io/projected/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-kube-api-access-2gh6f\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.853234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbx5\" (UniqueName: \"kubernetes.io/projected/bc17e1f7-bd48-4bc6-af52-5318f946462f-kube-api-access-mgbx5\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.853234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc17e1f7-bd48-4bc6-af52-5318f946462f-tmp-dir\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.853234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.853203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc17e1f7-bd48-4bc6-af52-5318f946462f-config-volume\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.954464 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-cert\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gh6f\" (UniqueName: \"kubernetes.io/projected/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-kube-api-access-2gh6f\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbx5\" (UniqueName: \"kubernetes.io/projected/bc17e1f7-bd48-4bc6-af52-5318f946462f-kube-api-access-mgbx5\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc17e1f7-bd48-4bc6-af52-5318f946462f-tmp-dir\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:06.954584 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:06.954648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.954602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc17e1f7-bd48-4bc6-af52-5318f946462f-config-volume\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.954908 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:06.954679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:07.454649854 +0000 UTC m=+36.491835536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:06.955211 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.955195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc17e1f7-bd48-4bc6-af52-5318f946462f-config-volume\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.955638 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.955622 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc17e1f7-bd48-4bc6-af52-5318f946462f-tmp-dir\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.959828 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.959773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-cert\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:06.963502 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.963481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbx5\" (UniqueName: \"kubernetes.io/projected/bc17e1f7-bd48-4bc6-af52-5318f946462f-kube-api-access-mgbx5\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:06.964516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:06.964465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gh6f\" (UniqueName: \"kubernetes.io/projected/ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5-kube-api-access-2gh6f\") pod \"ingress-canary-kl9ks\" (UID: \"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5\") " pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:07.072672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.072636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kl9ks" Jun 12 17:38:07.227520 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.227277 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kl9ks"] Jun 12 17:38:07.233531 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:38:07.233485 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6f19ac_a96f_4c8e_8f6c_41bbcee072c5.slice/crio-3ab193a07fae6403772332ffc566f37842001413d9d0130e7a04109ef6690dbb WatchSource:0}: Error finding container 3ab193a07fae6403772332ffc566f37842001413d9d0130e7a04109ef6690dbb: Status 404 returned error can't find the container with id 3ab193a07fae6403772332ffc566f37842001413d9d0130e7a04109ef6690dbb Jun 12 17:38:07.442813 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.442781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:07.442991 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.442781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:07.445389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.445361 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 17:38:07.445527 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.445471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 17:38:07.445527 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.445476 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8p5z\"" Jun 12 17:38:07.459114 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.459089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:07.459276 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:07.459256 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:07.459447 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:07.459323 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:08.459303478 +0000 UTC m=+37.496489162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:07.680723 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:07.680687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kl9ks" event={"ID":"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5","Type":"ContainerStarted","Data":"3ab193a07fae6403772332ffc566f37842001413d9d0130e7a04109ef6690dbb"} Jun 12 17:38:08.439375 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:08.439329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:08.442287 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:08.442261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5w2c4\"" Jun 12 17:38:08.442511 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:08.442492 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 17:38:08.442745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:08.442723 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 17:38:08.468856 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:08.468832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:08.469028 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:08.469009 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:08.469094 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:08.469076 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:10.469061204 +0000 UTC m=+39.506246879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:10.484523 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:10.484486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:10.484912 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:10.484638 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:10.484912 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:10.484701 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:14.484685855 +0000 UTC m=+43.521871530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:10.690872 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:10.690834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kl9ks" event={"ID":"ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5","Type":"ContainerStarted","Data":"692b996fe7209d3d99cebf23cc0b947c09e291b374d2ac214ef59ff59458b3ef"} Jun 12 17:38:10.693977 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:10.693952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerStarted","Data":"e87840c2a9f811c056757e9d5ad42abfc9a2030df6cac7028e3a14ed1b895ce7"} Jun 12 17:38:10.709723 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:10.709651 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kl9ks" podStartSLOduration=1.422709952 podStartE2EDuration="4.709635307s" totalImagesPullingTime="3.286925355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:38:10.708227422 +0000 UTC m=+39.745413116" watchObservedRunningTime="2026-06-12 17:38:10.709635307 +0000 UTC m=+39.746821000" Jun 12 17:38:11.698755 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:11.698584 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="e87840c2a9f811c056757e9d5ad42abfc9a2030df6cac7028e3a14ed1b895ce7" exitCode=0 Jun 12 17:38:11.699182 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:11.698675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"e87840c2a9f811c056757e9d5ad42abfc9a2030df6cac7028e3a14ed1b895ce7"} Jun 12 17:38:12.703272 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:12.703236 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed4cfb3f-637d-48ee-99ca-60061877139d" containerID="ea9722df1ec28ddef127452f1818e44d85d4da0abfd0f57d99d2aa58ce6094dc" exitCode=0 Jun 12 17:38:12.703630 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:12.703313 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerDied","Data":"ea9722df1ec28ddef127452f1818e44d85d4da0abfd0f57d99d2aa58ce6094dc"} Jun 12 17:38:13.709007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:13.708968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" event={"ID":"ed4cfb3f-637d-48ee-99ca-60061877139d","Type":"ContainerStarted","Data":"220b50bbb6349a13c03b086f0647b97539d6baa396dffcc706adf7abd8e59c25"} Jun 12 17:38:13.732426 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:13.732372 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zrp2x" podStartSLOduration=9.742963911 podStartE2EDuration="42.732357953s" totalImagesPullingTime="32.989394042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:38:13.730847075 +0000 UTC m=+42.768032780" watchObservedRunningTime="2026-06-12 17:38:13.732357953 +0000 UTC m=+42.769543645" Jun 12 17:38:14.512517 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:14.512471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:14.512725 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:14.512590 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:14.512725 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:14.512640 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:22.512627747 +0000 UTC m=+51.549813418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:22.571306 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:22.571271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:22.571777 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:22.571392 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:22.571777 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:22.571442 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:38:38.571427639 +0000 UTC m=+67.608613311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:33.676420 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:33.676396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6lks" Jun 12 17:38:36.161108 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.161058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:38:36.163684 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.163664 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 17:38:36.171900 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:36.171883 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 17:38:36.171982 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:36.171971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:39:40.171952639 +0000 UTC m=+129.209138315 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : secret "metrics-daemon-secret" not found Jun 12 17:38:36.261724 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.261683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:36.264769 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.264751 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 17:38:36.275809 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.275780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc1a2667-2314-4331-a789-b42dddd53616-original-pull-secret\") pod \"global-pull-secret-syncer-9vjtb\" (UID: \"dc1a2667-2314-4331-a789-b42dddd53616\") " pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:36.362581 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.362535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:36.365152 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.365135 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 17:38:36.375443 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.375427 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 17:38:36.385823 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.385798 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcvb\" (UniqueName: \"kubernetes.io/projected/868e2e9e-39a1-4009-a29a-ad389c9087a5-kube-api-access-brcvb\") pod \"network-check-target-9gbss\" (UID: \"868e2e9e-39a1-4009-a29a-ad389c9087a5\") " pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:36.563130 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.563090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vjtb" Jun 12 17:38:36.654006 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.653831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5w2c4\"" Jun 12 17:38:36.661672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.661646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:36.687264 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.687231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vjtb"] Jun 12 17:38:36.690239 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:38:36.690193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1a2667_2314_4331_a789_b42dddd53616.slice/crio-ab786cfb96e8a3206ca8a04902c37d9ce6979fe30b99849a4551522b0a1b9bb2 WatchSource:0}: Error finding container ab786cfb96e8a3206ca8a04902c37d9ce6979fe30b99849a4551522b0a1b9bb2: Status 404 returned error can't find the container with id ab786cfb96e8a3206ca8a04902c37d9ce6979fe30b99849a4551522b0a1b9bb2 Jun 12 17:38:36.763315 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.763278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vjtb" event={"ID":"dc1a2667-2314-4331-a789-b42dddd53616","Type":"ContainerStarted","Data":"ab786cfb96e8a3206ca8a04902c37d9ce6979fe30b99849a4551522b0a1b9bb2"} Jun 12 17:38:36.789296 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:36.789264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gbss"] Jun 12 17:38:36.792142 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:38:36.792116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868e2e9e_39a1_4009_a29a_ad389c9087a5.slice/crio-44d984074e11782a796c1bb618a0a78dd228f5bc85aa0c9f215ada1578ab726c WatchSource:0}: Error finding container 44d984074e11782a796c1bb618a0a78dd228f5bc85aa0c9f215ada1578ab726c: Status 404 returned error can't find the container with id 44d984074e11782a796c1bb618a0a78dd228f5bc85aa0c9f215ada1578ab726c Jun 12 17:38:37.767244 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:37.767207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gbss" event={"ID":"868e2e9e-39a1-4009-a29a-ad389c9087a5","Type":"ContainerStarted","Data":"44d984074e11782a796c1bb618a0a78dd228f5bc85aa0c9f215ada1578ab726c"} Jun 12 17:38:38.577141 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:38.577104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:38:38.577306 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:38.577229 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:38:38.577306 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:38:38.577303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:39:10.577282952 +0000 UTC m=+99.614468639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:38:40.780241 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:40.780197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gbss" event={"ID":"868e2e9e-39a1-4009-a29a-ad389c9087a5","Type":"ContainerStarted","Data":"03de7c305faf2a6e038c553ae14c50b5e6a80cc3a1e94317ae9f547fd4294d87"} Jun 12 17:38:40.780722 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:40.780320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:38:40.799282 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:40.799227 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9gbss" podStartSLOduration=66.665111079 podStartE2EDuration="1m9.799207104s" totalImagesPullingTime="3.134096025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:38:40.797910199 +0000 UTC m=+69.835095901" watchObservedRunningTime="2026-06-12 17:38:40.799207104 +0000 UTC m=+69.836392799" Jun 12 17:38:41.784771 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:41.784645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vjtb" event={"ID":"dc1a2667-2314-4331-a789-b42dddd53616","Type":"ContainerStarted","Data":"a6745974a493b7a0e5573355487a1a42b92739dcda7cd782b65e65de95995b36"} Jun 12 17:38:41.801314 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:38:41.801260 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9vjtb" podStartSLOduration=65.928498805 podStartE2EDuration="1m10.801246294s" totalImagesPullingTime="4.872747489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:38:41.800278469 +0000 UTC m=+70.837464163" watchObservedRunningTime="2026-06-12 17:38:41.801246294 +0000 UTC m=+70.838432022" Jun 12 17:39:10.591163 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:39:10.591120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:39:10.591582 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:39:10.591280 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:39:10.591582 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:39:10.591347 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:40:14.591329827 +0000 UTC m=+163.628515502 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:39:11.787640 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:39:11.787608 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9gbss" Jun 12 17:39:40.190102 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:39:40.190064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:39:40.190510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:39:40.190212 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 17:39:40.190510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:39:40.190278 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs podName:dde20f0e-471c-44f1-87ca-259faae3c93a nodeName:}" failed. No retries permitted until 2026-06-12 17:41:42.190260694 +0000 UTC m=+251.227446365 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs") pod "network-metrics-daemon-jqc8l" (UID: "dde20f0e-471c-44f1-87ca-259faae3c93a") : secret "metrics-daemon-secret" not found Jun 12 17:40:09.765758 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:40:09.765702 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7lnsw" podUID="bc17e1f7-bd48-4bc6-af52-5318f946462f" Jun 12 17:40:09.989597 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:40:09.988494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:40:10.456531 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:40:10.456493 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jqc8l" podUID="dde20f0e-471c-44f1-87ca-259faae3c93a" Jun 12 17:40:14.629567 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:40:14.629470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:40:14.629949 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:40:14.629629 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 17:40:14.629949 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:40:14.629704 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls podName:bc17e1f7-bd48-4bc6-af52-5318f946462f nodeName:}" failed. No retries permitted until 2026-06-12 17:42:16.629687001 +0000 UTC m=+285.666872677 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls") pod "dns-default-7lnsw" (UID: "bc17e1f7-bd48-4bc6-af52-5318f946462f") : secret "dns-default-metrics-tls" not found Jun 12 17:40:25.439764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:40:25.439719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:41:06.184186 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.184152 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7"] Jun 12 17:41:06.185885 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.185870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.189470 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.189445 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 12 17:41:06.190074 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.190051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rd6f6\"" Jun 12 17:41:06.190171 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.190077 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 12 17:41:06.190171 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.190057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 12 17:41:06.205212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.202108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7"] Jun 12 17:41:06.256810 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.256770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.256993 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.256838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcc9r\" (UniqueName: \"kubernetes.io/projected/c169498f-3bcb-4d75-964c-78625f5d47c5-kube-api-access-qcc9r\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.293976 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.293943 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79d6cc649d-9zh9g"] Jun 12 17:41:06.295780 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.295762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.299869 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.299849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 17:41:06.300007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.299894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 12 17:41:06.300007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.299895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 12 17:41:06.300103 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.300031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 17:41:06.300144 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.300106 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 12 17:41:06.300552 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.300536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 12 17:41:06.301477 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.301462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkr59\"" Jun 12 17:41:06.307361 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.307343 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl"] Jun 12 17:41:06.309005 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.308991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.312186 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.312166 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 12 17:41:06.312293 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.312277 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 12 17:41:06.312415 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.312398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 12 17:41:06.312526 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.312510 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dn9d5\"" Jun 12 17:41:06.312577 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.312568 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 12 17:41:06.313201 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.313184 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gvfz7"] Jun 12 17:41:06.315087 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.314914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.316655 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.316636 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d6cc649d-9zh9g"] Jun 12 17:41:06.318058 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.318032 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 17:41:06.318168 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.318150 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 12 17:41:06.318780 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.318762 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 17:41:06.318858 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.318825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 12 17:41:06.319791 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.319723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qrzsq\"" Jun 12 17:41:06.328207 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.328190 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 12 17:41:06.332353 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.332306 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl"] Jun 12 17:41:06.336568 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.336536 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gvfz7"] Jun 12 17:41:06.357105 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcc9r\" (UniqueName: \"kubernetes.io/projected/c169498f-3bcb-4d75-964c-78625f5d47c5-kube-api-access-qcc9r\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.357232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.357232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-tmp\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.357304 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.357304 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.357304 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vccqt\" (UniqueName: \"kubernetes.io/projected/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-kube-api-access-vccqt\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.357400 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-default-certificate\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.357400 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-stats-auth\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.357400 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.357364 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 17:41:06.357400 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggm9\" (UniqueName: \"kubernetes.io/projected/a348a5e7-8064-4361-8ef7-3a70f88dd904-kube-api-access-hggm9\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.357516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.357516 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.357423 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls podName:c169498f-3bcb-4d75-964c-78625f5d47c5 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:06.857405888 +0000 UTC m=+215.894591578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pgjk7" (UID: "c169498f-3bcb-4d75-964c-78625f5d47c5") : secret "samples-operator-tls" not found Jun 12 17:41:06.357516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7gz\" (UniqueName: \"kubernetes.io/projected/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-kube-api-access-hr7gz\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.357516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.357692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.357692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-config\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.357692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-snapshots\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.357692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.357588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.366628 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.366604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcc9r\" (UniqueName: \"kubernetes.io/projected/c169498f-3bcb-4d75-964c-78625f5d47c5-kube-api-access-qcc9r\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.378303 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.378275 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb"] Jun 12 17:41:06.380161 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.380144 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" Jun 12 17:41:06.382476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.382453 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 12 17:41:06.382476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.382453 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 12 17:41:06.382598 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.382497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-66lnv\"" Jun 12 17:41:06.391031 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.391009 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb"] Jun 12 17:41:06.458796 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-tmp\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.458796 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.458796 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vccqt\" (UniqueName: \"kubernetes.io/projected/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-kube-api-access-vccqt\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.458796 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-default-certificate\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.458796 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-stats-auth\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggm9\" (UniqueName: \"kubernetes.io/projected/a348a5e7-8064-4361-8ef7-3a70f88dd904-kube-api-access-hggm9\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mv9\" (UniqueName: \"kubernetes.io/projected/7fed2d3c-2ab8-4955-a4ce-53f07b096680-kube-api-access-d9mv9\") pod \"volume-data-source-validator-bd4ccd799-7znnb\" (UID: \"7fed2d3c-2ab8-4955-a4ce-53f07b096680\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7gz\" (UniqueName: \"kubernetes.io/projected/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-kube-api-access-hr7gz\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.458994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-config\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-snapshots\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.459212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459203 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-tmp\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459744 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.459317 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:06.959295423 +0000 UTC m=+215.996481114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : configmap references non-existent config key: service-ca.crt Jun 12 17:41:06.459744 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459688 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.459744 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.459709 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 17:41:06.459905 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.459776 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:06.95975673 +0000 UTC m=+215.996942418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : secret "router-metrics-certs-default" not found Jun 12 17:41:06.459996 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.459904 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-config\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.460353 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.460324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-snapshots\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.460755 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.460731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.461557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.461537 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.461557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.461548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-default-certificate\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.461699 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.461684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-stats-auth\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.461797 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.461782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.468612 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.468589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggm9\" (UniqueName: \"kubernetes.io/projected/a348a5e7-8064-4361-8ef7-3a70f88dd904-kube-api-access-hggm9\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.468761 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.468735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vccqt\" (UniqueName: \"kubernetes.io/projected/8cb5156e-76f8-48b5-9651-4bd0cb9628c4-kube-api-access-vccqt\") pod \"service-ca-operator-7ccbfd59dc-s6svl\" (UID: \"8cb5156e-76f8-48b5-9651-4bd0cb9628c4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.469323 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.469301 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7gz\" (UniqueName: \"kubernetes.io/projected/5afeed3b-81c5-4f66-a92d-6dc43db97e5b-kube-api-access-hr7gz\") pod \"insights-operator-5bbd86d6bd-gvfz7\" (UID: \"5afeed3b-81c5-4f66-a92d-6dc43db97e5b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.559625 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.559573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mv9\" (UniqueName: \"kubernetes.io/projected/7fed2d3c-2ab8-4955-a4ce-53f07b096680-kube-api-access-d9mv9\") pod \"volume-data-source-validator-bd4ccd799-7znnb\" (UID: \"7fed2d3c-2ab8-4955-a4ce-53f07b096680\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" Jun 12 17:41:06.568967 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.568924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mv9\" (UniqueName: \"kubernetes.io/projected/7fed2d3c-2ab8-4955-a4ce-53f07b096680-kube-api-access-d9mv9\") pod \"volume-data-source-validator-bd4ccd799-7znnb\" (UID: \"7fed2d3c-2ab8-4955-a4ce-53f07b096680\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" Jun 12 17:41:06.618920 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.618882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" Jun 12 17:41:06.625439 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.625413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" Jun 12 17:41:06.689344 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.689308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" Jun 12 17:41:06.760038 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.760008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl"] Jun 12 17:41:06.763398 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:06.763366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb5156e_76f8_48b5_9651_4bd0cb9628c4.slice/crio-64ab12843f444bd0ccdaad4c7d78abc0798460585520d6955589986e69588ff7 WatchSource:0}: Error finding container 64ab12843f444bd0ccdaad4c7d78abc0798460585520d6955589986e69588ff7: Status 404 returned error can't find the container with id 64ab12843f444bd0ccdaad4c7d78abc0798460585520d6955589986e69588ff7 Jun 12 17:41:06.773726 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.773700 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gvfz7"] Jun 12 17:41:06.776089 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:06.776061 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afeed3b_81c5_4f66_a92d_6dc43db97e5b.slice/crio-8ab1263c6bfbdc80bb31e1a7366638610ce3476610f6af0e03650ac1d0d5b19f WatchSource:0}: Error finding container 8ab1263c6bfbdc80bb31e1a7366638610ce3476610f6af0e03650ac1d0d5b19f: Status 404 returned error can't find the container with id 8ab1263c6bfbdc80bb31e1a7366638610ce3476610f6af0e03650ac1d0d5b19f Jun 12 17:41:06.826373 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.826341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb"] Jun 12 17:41:06.829537 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:06.829510 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fed2d3c_2ab8_4955_a4ce_53f07b096680.slice/crio-25a7319a91bce5fb5db785f0d39a84edb37af982c031aaf7251df1f0a8b0da31 WatchSource:0}: Error finding container 25a7319a91bce5fb5db785f0d39a84edb37af982c031aaf7251df1f0a8b0da31: Status 404 returned error can't find the container with id 25a7319a91bce5fb5db785f0d39a84edb37af982c031aaf7251df1f0a8b0da31 Jun 12 17:41:06.863304 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.863266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:06.863460 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.863413 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 17:41:06.863505 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.863470 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls podName:c169498f-3bcb-4d75-964c-78625f5d47c5 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:07.863455398 +0000 UTC m=+216.900641069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pgjk7" (UID: "c169498f-3bcb-4d75-964c-78625f5d47c5") : secret "samples-operator-tls" not found Jun 12 17:41:06.964101 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.964010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.964101 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:06.964073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:06.964290 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.964180 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:07.96416428 +0000 UTC m=+217.001349951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : configmap references non-existent config key: service-ca.crt Jun 12 17:41:06.964290 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.964186 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 17:41:06.964290 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:06.964228 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:07.964216053 +0000 UTC m=+217.001401723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : secret "router-metrics-certs-default" not found Jun 12 17:41:07.121659 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.121623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" event={"ID":"5afeed3b-81c5-4f66-a92d-6dc43db97e5b","Type":"ContainerStarted","Data":"8ab1263c6bfbdc80bb31e1a7366638610ce3476610f6af0e03650ac1d0d5b19f"} Jun 12 17:41:07.122769 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.122748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" event={"ID":"7fed2d3c-2ab8-4955-a4ce-53f07b096680","Type":"ContainerStarted","Data":"25a7319a91bce5fb5db785f0d39a84edb37af982c031aaf7251df1f0a8b0da31"} Jun 12 17:41:07.123708 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.123690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" event={"ID":"8cb5156e-76f8-48b5-9651-4bd0cb9628c4","Type":"ContainerStarted","Data":"64ab12843f444bd0ccdaad4c7d78abc0798460585520d6955589986e69588ff7"} Jun 12 17:41:07.870946 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.870901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:07.871971 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:07.871072 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 17:41:07.871971 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:07.871154 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls podName:c169498f-3bcb-4d75-964c-78625f5d47c5 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:09.871131626 +0000 UTC m=+218.908317318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pgjk7" (UID: "c169498f-3bcb-4d75-964c-78625f5d47c5") : secret "samples-operator-tls" not found Jun 12 17:41:07.971467 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.971353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:07.971467 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:07.971445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:07.971705 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:07.971536 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 17:41:07.971705 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:07.971592 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:09.971573253 +0000 UTC m=+219.008758937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : configmap references non-existent config key: service-ca.crt Jun 12 17:41:07.971705 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:07.971618 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:09.971600411 +0000 UTC m=+219.008786099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : secret "router-metrics-certs-default" not found Jun 12 17:41:09.130658 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:09.130620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" event={"ID":"7fed2d3c-2ab8-4955-a4ce-53f07b096680","Type":"ContainerStarted","Data":"1ec78bb2a82d1918d7a60daba5f2b96e3a030c34e0420bb3f8d762174a08eda2"} Jun 12 17:41:09.146399 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:09.146344 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-7znnb" podStartSLOduration=1.793621167 podStartE2EDuration="3.146325125s" totalImagesPullingTime="1.352703958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:09.145694102 +0000 UTC m=+218.182879795" watchObservedRunningTime="2026-06-12 17:41:09.146325125 +0000 UTC m=+218.183510820" Jun 12 17:41:09.886192 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:09.886101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:09.886361 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:09.886268 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 17:41:09.886361 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:09.886342 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls podName:c169498f-3bcb-4d75-964c-78625f5d47c5 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:13.886323081 +0000 UTC m=+222.923508755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pgjk7" (UID: "c169498f-3bcb-4d75-964c-78625f5d47c5") : secret "samples-operator-tls" not found Jun 12 17:41:09.986468 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:09.986425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:09.986650 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:09.986512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:09.986650 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:09.986597 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 17:41:09.986650 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:09.986599 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:13.986580873 +0000 UTC m=+223.023766547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : configmap references non-existent config key: service-ca.crt Jun 12 17:41:09.986650 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:09.986650 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:13.986639536 +0000 UTC m=+223.023825207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : secret "router-metrics-certs-default" not found Jun 12 17:41:10.135306 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.135274 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" event={"ID":"5afeed3b-81c5-4f66-a92d-6dc43db97e5b","Type":"ContainerStarted","Data":"1ac95f52811cccadb0c8ec70eff2bcb3b6c28ed365f0c124d867f4559dafc8eb"} Jun 12 17:41:10.136870 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.136797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" event={"ID":"8cb5156e-76f8-48b5-9651-4bd0cb9628c4","Type":"ContainerStarted","Data":"ec94425470921af6689bdbb62cdc35c71b1262ddb52ab6d3f354fe8a1c317eec"} Jun 12 17:41:10.152423 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.152378 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" podStartSLOduration=1.350477096 podStartE2EDuration="4.152363712s" totalImagesPullingTime="2.801886616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:10.150879458 +0000 UTC m=+219.188065154" watchObservedRunningTime="2026-06-12 17:41:10.152363712 +0000 UTC m=+219.189549383" Jun 12 17:41:10.166101 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.166051 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" podStartSLOduration=1.349242543 podStartE2EDuration="4.166033047s" totalImagesPullingTime="2.816790504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:10.165501247 +0000 UTC m=+219.202686943" watchObservedRunningTime="2026-06-12 17:41:10.166033047 +0000 UTC m=+219.203218742" Jun 12 17:41:10.647297 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.647267 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z2tsl"] Jun 12 17:41:10.649773 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.649750 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.652316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.652286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 17:41:10.652427 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.652315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 17:41:10.652427 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.652287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j4cvj\"" Jun 12 17:41:10.663128 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.663107 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z2tsl"] Jun 12 17:41:10.692690 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.692660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca459b33-6832-4f9a-8260-d8ede9cfe55f-crio-socket\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.692690 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.692693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grlxk\" (UniqueName: \"kubernetes.io/projected/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-api-access-grlxk\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.692874 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.692738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca459b33-6832-4f9a-8260-d8ede9cfe55f-data-volume\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.692874 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.692754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.692874 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.692806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793277 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca459b33-6832-4f9a-8260-d8ede9cfe55f-crio-socket\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793277 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grlxk\" (UniqueName: \"kubernetes.io/projected/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-api-access-grlxk\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793524 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca459b33-6832-4f9a-8260-d8ede9cfe55f-data-volume\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793524 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793524 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793524 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:10.793518 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 17:41:10.793721 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:10.793540 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 17:41:10.793721 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:10.793578 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:11.29355917 +0000 UTC m=+220.330744860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : configmap "kube-rbac-proxy" not found Jun 12 17:41:10.793721 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:10.793592 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:11.293585984 +0000 UTC m=+220.330771654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : secret "insights-runtime-extractor-tls" not found Jun 12 17:41:10.793721 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793540 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca459b33-6832-4f9a-8260-d8ede9cfe55f-crio-socket\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.793721 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.793665 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca459b33-6832-4f9a-8260-d8ede9cfe55f-data-volume\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:10.802195 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:10.802178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grlxk\" (UniqueName: \"kubernetes.io/projected/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-api-access-grlxk\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:11.298065 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:11.298031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:11.298065 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:11.298068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:11.298510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:11.298168 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 17:41:11.298510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:11.298170 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 17:41:11.298510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:11.298219 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:12.298206498 +0000 UTC m=+221.335392168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : configmap "kube-rbac-proxy" not found Jun 12 17:41:11.298510 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:11.298231 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:12.298225554 +0000 UTC m=+221.335411225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : secret "insights-runtime-extractor-tls" not found Jun 12 17:41:12.308218 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:12.308182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:12.308218 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:12.308222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:12.308615 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:12.308291 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 17:41:12.308615 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:12.308341 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 17:41:12.308615 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:12.308346 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:14.308332112 +0000 UTC m=+223.345517782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : configmap "kube-rbac-proxy" not found Jun 12 17:41:12.308615 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:12.308426 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:14.308407939 +0000 UTC m=+223.345593623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : secret "insights-runtime-extractor-tls" not found Jun 12 17:41:13.234007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.233980 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h9lw_2c891c1c-fcf1-418f-a049-46bef8baec37/dns-node-resolver/0.log" Jun 12 17:41:13.531675 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.531599 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ttgwv"] Jun 12 17:41:13.534239 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.534217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.536869 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.536848 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 17:41:13.537230 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.537200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 17:41:13.537357 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.537253 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 17:41:13.538061 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.538042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 17:41:13.538153 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.538082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ngwsz\"" Jun 12 17:41:13.544571 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.544547 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ttgwv"] Jun 12 17:41:13.618681 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.618650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-cabundle\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.618864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.618713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-key\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.618864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.618739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49sxh\" (UniqueName: \"kubernetes.io/projected/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-kube-api-access-49sxh\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.719942 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.719904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-key\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.720099 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.719964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49sxh\" (UniqueName: \"kubernetes.io/projected/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-kube-api-access-49sxh\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.720099 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.720031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-cabundle\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.720651 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.720631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-cabundle\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.722453 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.722437 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-signing-key\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.728830 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.728805 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49sxh\" (UniqueName: \"kubernetes.io/projected/a9e99ce6-7871-479b-b2cf-a8768ccef4ff-kube-api-access-49sxh\") pod \"service-ca-7b994bc59-ttgwv\" (UID: \"a9e99ce6-7871-479b-b2cf-a8768ccef4ff\") " pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.844556 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.844480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" Jun 12 17:41:13.923686 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.923659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:13.923847 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:13.923826 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 17:41:13.923908 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:13.923893 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls podName:c169498f-3bcb-4d75-964c-78625f5d47c5 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:21.923878387 +0000 UTC m=+230.961064057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pgjk7" (UID: "c169498f-3bcb-4d75-964c-78625f5d47c5") : secret "samples-operator-tls" not found Jun 12 17:41:13.966442 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:13.966412 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ttgwv"] Jun 12 17:41:13.969058 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:13.969029 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e99ce6_7871_479b_b2cf_a8768ccef4ff.slice/crio-c3218a96cd910c794d59d03e4f091ddacdc8f16048a037c4c192ac02838016b0 WatchSource:0}: Error finding container c3218a96cd910c794d59d03e4f091ddacdc8f16048a037c4c192ac02838016b0: Status 404 returned error can't find the container with id c3218a96cd910c794d59d03e4f091ddacdc8f16048a037c4c192ac02838016b0 Jun 12 17:41:14.024850 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.024825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:14.024966 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.024949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:14.025042 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.025027 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:22.024990001 +0000 UTC m=+231.062175689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : configmap references non-existent config key: service-ca.crt Jun 12 17:41:14.025096 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.025061 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 17:41:14.025130 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.025121 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs podName:a348a5e7-8064-4361-8ef7-3a70f88dd904 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:22.025104926 +0000 UTC m=+231.062290610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs") pod "router-default-79d6cc649d-9zh9g" (UID: "a348a5e7-8064-4361-8ef7-3a70f88dd904") : secret "router-metrics-certs-default" not found Jun 12 17:41:14.149398 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.149303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" event={"ID":"a9e99ce6-7871-479b-b2cf-a8768ccef4ff","Type":"ContainerStarted","Data":"df5feea1086e88c408842ecd8077be90cb78d2b06ef80011c74ef161756337ef"} Jun 12 17:41:14.149398 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.149355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" event={"ID":"a9e99ce6-7871-479b-b2cf-a8768ccef4ff","Type":"ContainerStarted","Data":"c3218a96cd910c794d59d03e4f091ddacdc8f16048a037c4c192ac02838016b0"} Jun 12 17:41:14.169525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.169484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-ttgwv" podStartSLOduration=1.169469797 podStartE2EDuration="1.169469797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:14.168601819 +0000 UTC m=+223.205787514" watchObservedRunningTime="2026-06-12 17:41:14.169469797 +0000 UTC m=+223.206655541" Jun 12 17:41:14.326843 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.326801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:14.326843 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.326845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:14.327112 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.326960 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 17:41:14.327112 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.326961 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 17:41:14.327112 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.327018 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:18.327004178 +0000 UTC m=+227.364189850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : configmap "kube-rbac-proxy" not found Jun 12 17:41:14.327112 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:14.327036 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:18.327023774 +0000 UTC m=+227.364209448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : secret "insights-runtime-extractor-tls" not found Jun 12 17:41:14.635180 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:14.635151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrfdv_f5f2d5bf-ca7b-486a-89ab-abfebf500d5b/node-ca/0.log" Jun 12 17:41:15.237282 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:15.237252 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kl9ks_ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5/serve-healthcheck-canary/0.log" Jun 12 17:41:18.359565 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:18.359532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:18.359565 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:18.359571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:18.360074 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:18.359680 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 17:41:18.360074 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:18.359712 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 17:41:18.360074 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:18.359743 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:26.359724458 +0000 UTC m=+235.396910143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : configmap "kube-rbac-proxy" not found Jun 12 17:41:18.360074 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:18.359794 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls podName:ca459b33-6832-4f9a-8260-d8ede9cfe55f nodeName:}" failed. No retries permitted until 2026-06-12 17:41:26.359774282 +0000 UTC m=+235.396959971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z2tsl" (UID: "ca459b33-6832-4f9a-8260-d8ede9cfe55f") : secret "insights-runtime-extractor-tls" not found Jun 12 17:41:21.991541 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:21.991415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:21.992623 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:21.991996 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c169498f-3bcb-4d75-964c-78625f5d47c5-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pgjk7\" (UID: \"c169498f-3bcb-4d75-964c-78625f5d47c5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:22.093142 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.093103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:22.093356 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.093225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:22.093944 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.093897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a348a5e7-8064-4361-8ef7-3a70f88dd904-service-ca-bundle\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:22.094040 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.093921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" Jun 12 17:41:22.095679 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.095654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a348a5e7-8064-4361-8ef7-3a70f88dd904-metrics-certs\") pod \"router-default-79d6cc649d-9zh9g\" (UID: \"a348a5e7-8064-4361-8ef7-3a70f88dd904\") " pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:22.204525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.204487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:22.226054 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.226024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7"] Jun 12 17:41:22.345660 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:22.345631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d6cc649d-9zh9g"] Jun 12 17:41:22.349507 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:22.349482 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda348a5e7_8064_4361_8ef7_3a70f88dd904.slice/crio-4422318af6e593bf2978556cc95b9acbcb20a1217c623f1a21cb970895a9493a WatchSource:0}: Error finding container 4422318af6e593bf2978556cc95b9acbcb20a1217c623f1a21cb970895a9493a: Status 404 returned error can't find the container with id 4422318af6e593bf2978556cc95b9acbcb20a1217c623f1a21cb970895a9493a Jun 12 17:41:23.178577 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.178533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" event={"ID":"a348a5e7-8064-4361-8ef7-3a70f88dd904","Type":"ContainerStarted","Data":"da617cff2ba8f0e49ea582c417cd757da461eb0a755f4344035976feb7865f47"} Jun 12 17:41:23.179028 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.178594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" event={"ID":"a348a5e7-8064-4361-8ef7-3a70f88dd904","Type":"ContainerStarted","Data":"4422318af6e593bf2978556cc95b9acbcb20a1217c623f1a21cb970895a9493a"} Jun 12 17:41:23.179789 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.179764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" event={"ID":"c169498f-3bcb-4d75-964c-78625f5d47c5","Type":"ContainerStarted","Data":"10cd4c0f34b8e375f02817b4b616a71701289a092744ea18e6ce2ff3c00ab58c"} Jun 12 17:41:23.202470 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.202414 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" podStartSLOduration=17.202393947 podStartE2EDuration="17.202393947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:23.202194939 +0000 UTC m=+232.239380949" watchObservedRunningTime="2026-06-12 17:41:23.202393947 +0000 UTC m=+232.239579642" Jun 12 17:41:23.205230 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.205206 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:23.208008 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:23.207985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:24.183568 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:24.183534 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:24.185239 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:24.185215 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79d6cc649d-9zh9g" Jun 12 17:41:25.188407 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:25.188373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" event={"ID":"c169498f-3bcb-4d75-964c-78625f5d47c5","Type":"ContainerStarted","Data":"df9440ce8db87a25a6375b4b9a31c2fe399a9ba3f7abf0e34cb19e661d6cdab2"} Jun 12 17:41:25.188756 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:25.188422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" event={"ID":"c169498f-3bcb-4d75-964c-78625f5d47c5","Type":"ContainerStarted","Data":"a600277f690583156341d9116a7cd904f70ad3134d2fae4078be89a8991d0bc5"} Jun 12 17:41:25.204990 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:25.204923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pgjk7" podStartSLOduration=17.215485276 podStartE2EDuration="19.204907127s" totalImagesPullingTime="1.989421851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:25.204505154 +0000 UTC m=+234.241690952" watchObservedRunningTime="2026-06-12 17:41:25.204907127 +0000 UTC m=+234.242092822" Jun 12 17:41:26.429221 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.429183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:26.429221 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.429223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:26.429726 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.429710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca459b33-6832-4f9a-8260-d8ede9cfe55f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:26.431626 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.431593 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca459b33-6832-4f9a-8260-d8ede9cfe55f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z2tsl\" (UID: \"ca459b33-6832-4f9a-8260-d8ede9cfe55f\") " pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:26.560095 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.560054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z2tsl" Jun 12 17:41:26.693619 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:26.693543 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z2tsl"] Jun 12 17:41:26.696295 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:26.696269 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca459b33_6832_4f9a_8260_d8ede9cfe55f.slice/crio-2498d7a527f8640c6c0d1a880479895972c701283a1e344ebda079a8a898a277 WatchSource:0}: Error finding container 2498d7a527f8640c6c0d1a880479895972c701283a1e344ebda079a8a898a277: Status 404 returned error can't find the container with id 2498d7a527f8640c6c0d1a880479895972c701283a1e344ebda079a8a898a277 Jun 12 17:41:27.197801 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:27.197759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z2tsl" event={"ID":"ca459b33-6832-4f9a-8260-d8ede9cfe55f","Type":"ContainerStarted","Data":"2498d7a527f8640c6c0d1a880479895972c701283a1e344ebda079a8a898a277"} Jun 12 17:41:30.209866 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:30.209831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z2tsl" event={"ID":"ca459b33-6832-4f9a-8260-d8ede9cfe55f","Type":"ContainerStarted","Data":"c328a213840287db607bddf45886b4036479b66fe4ec96ba3eb302c3c12618b1"} Jun 12 17:41:31.214729 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:31.214699 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z2tsl" event={"ID":"ca459b33-6832-4f9a-8260-d8ede9cfe55f","Type":"ContainerStarted","Data":"3bbbafc7328b9e7f618fcc728b0169df4c58e8f1ec3c83b1d3bd7556e0b39793"} Jun 12 17:41:33.033762 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.033729 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl"] Jun 12 17:41:33.036956 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.036917 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:33.040486 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.040463 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t4gnm\"" Jun 12 17:41:33.040609 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.040490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 17:41:33.046404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.046381 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl"] Jun 12 17:41:33.066951 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.066908 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-789b5cf674-vrlsg"] Jun 12 17:41:33.069945 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.069865 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.072479 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.072441 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 17:41:33.072597 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.072558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 17:41:33.072597 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.072567 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hrzfh\"" Jun 12 17:41:33.072860 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.072842 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 17:41:33.077699 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.077677 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 17:41:33.092787 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.092764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789b5cf674-vrlsg"] Jun 12 17:41:33.182994 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.182966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9094fd3f-3813-4d46-8541-7ea6a8db8c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-wtdkl\" (UID: \"9094fd3f-3813-4d46-8541-7ea6a8db8c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-ca-trust-extracted\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-bound-sa-token\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9ff\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-kube-api-access-hk9ff\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-certificates\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-image-registry-private-configuration\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183173 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-installation-pull-secrets\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183383 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-tls\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.183383 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.183202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-trusted-ca\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.223543 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.223509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z2tsl" event={"ID":"ca459b33-6832-4f9a-8260-d8ede9cfe55f","Type":"ContainerStarted","Data":"bff1bde6b10af963c2527a1faa5dea156661efef235a05cc3e3c57806df6e6dc"} Jun 12 17:41:33.244124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.244066 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z2tsl" podStartSLOduration=17.441040394 podStartE2EDuration="23.244048615s" totalImagesPullingTime="5.803008221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:41:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:33.243339588 +0000 UTC m=+242.280525281" watchObservedRunningTime="2026-06-12 17:41:33.244048615 +0000 UTC m=+242.281234308" Jun 12 17:41:33.284287 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9094fd3f-3813-4d46-8541-7ea6a8db8c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-wtdkl\" (UID: \"9094fd3f-3813-4d46-8541-7ea6a8db8c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:33.284287 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-ca-trust-extracted\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284287 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-bound-sa-token\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9ff\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-kube-api-access-hk9ff\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-certificates\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-image-registry-private-configuration\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-installation-pull-secrets\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-tls\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.284529 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.284417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-trusted-ca\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.285056 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.285000 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-ca-trust-extracted\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.285368 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.285300 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-certificates\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.285734 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.285709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-trusted-ca\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.287047 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.287020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-installation-pull-secrets\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.287166 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.287032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9094fd3f-3813-4d46-8541-7ea6a8db8c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-wtdkl\" (UID: \"9094fd3f-3813-4d46-8541-7ea6a8db8c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:33.287166 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.287079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-image-registry-private-configuration\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.287264 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.287167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-registry-tls\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.293382 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.293360 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-bound-sa-token\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.293514 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.293497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9ff\" (UniqueName: \"kubernetes.io/projected/6154f5d4-b81f-401e-bc0b-a3f7278bdf1e-kube-api-access-hk9ff\") pod \"image-registry-789b5cf674-vrlsg\" (UID: \"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e\") " pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.345517 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.345484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:33.381653 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.381615 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:33.484323 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.484295 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl"] Jun 12 17:41:33.487862 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:33.487837 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9094fd3f_3813_4d46_8541_7ea6a8db8c1c.slice/crio-b6617c54654af89393bc92c80686871eea0da6f836e06f7c6b52a63d471f8a6d WatchSource:0}: Error finding container b6617c54654af89393bc92c80686871eea0da6f836e06f7c6b52a63d471f8a6d: Status 404 returned error can't find the container with id b6617c54654af89393bc92c80686871eea0da6f836e06f7c6b52a63d471f8a6d Jun 12 17:41:33.535330 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:33.535250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789b5cf674-vrlsg"] Jun 12 17:41:33.538059 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:33.538034 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6154f5d4_b81f_401e_bc0b_a3f7278bdf1e.slice/crio-e17b04c854f7298cdf14f30219fc35f9e84aa2fcae39c2f7324ff9d99a1ce9eb WatchSource:0}: Error finding container e17b04c854f7298cdf14f30219fc35f9e84aa2fcae39c2f7324ff9d99a1ce9eb: Status 404 returned error can't find the container with id e17b04c854f7298cdf14f30219fc35f9e84aa2fcae39c2f7324ff9d99a1ce9eb Jun 12 17:41:34.228007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:34.227959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" event={"ID":"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e","Type":"ContainerStarted","Data":"90856162edb8b13d742a6e06f9e46f3290e78f11dc7d1fc7001c8ff029517e22"} Jun 12 17:41:34.228451 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:34.228029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" event={"ID":"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e","Type":"ContainerStarted","Data":"e17b04c854f7298cdf14f30219fc35f9e84aa2fcae39c2f7324ff9d99a1ce9eb"} Jun 12 17:41:34.228451 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:34.228083 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:41:34.229157 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:34.229134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" event={"ID":"9094fd3f-3813-4d46-8541-7ea6a8db8c1c","Type":"ContainerStarted","Data":"b6617c54654af89393bc92c80686871eea0da6f836e06f7c6b52a63d471f8a6d"} Jun 12 17:41:34.251553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:34.251502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podStartSLOduration=1.251485801 podStartE2EDuration="1.251485801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:34.250507889 +0000 UTC m=+243.287693583" watchObservedRunningTime="2026-06-12 17:41:34.251485801 +0000 UTC m=+243.288671488" Jun 12 17:41:35.234250 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:35.234218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" event={"ID":"9094fd3f-3813-4d46-8541-7ea6a8db8c1c","Type":"ContainerStarted","Data":"f75659e75754908170a5d2f7568a418bdcbdf6f8df97e2e2be7056f16db6a8e1"} Jun 12 17:41:35.251007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:35.250958 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" podStartSLOduration=0.871630247 podStartE2EDuration="2.250919779s" totalImagesPullingTime="1.379289532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:35.250155364 +0000 UTC m=+244.287341062" watchObservedRunningTime="2026-06-12 17:41:35.250919779 +0000 UTC m=+244.288105473" Jun 12 17:41:36.237760 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:36.237731 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:36.242371 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:36.242340 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-wtdkl" Jun 12 17:41:41.438621 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.438572 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r"] Jun 12 17:41:41.443589 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.443551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.446778 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.446754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 17:41:41.447189 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.447174 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 17:41:41.447458 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.447337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cdtqx\"" Jun 12 17:41:41.447458 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.447266 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 17:41:41.448320 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.448306 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 17:41:41.448671 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.448653 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 17:41:41.452271 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.452248 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rccbj"] Jun 12 17:41:41.455476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.455460 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.459152 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.459137 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 17:41:41.460755 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.460736 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 17:41:41.461378 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.461350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 17:41:41.461548 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.461534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gwg74\"" Jun 12 17:41:41.462587 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.462564 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h"] Jun 12 17:41:41.465823 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.465802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r"] Jun 12 17:41:41.466062 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.466049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.469083 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.469061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5b9jk\"" Jun 12 17:41:41.469300 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.469285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 17:41:41.469473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.469457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 17:41:41.469880 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.469861 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 17:41:41.481679 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.481658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h"] Jun 12 17:41:41.552620 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.552620 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef97404-5e44-4b86-a436-13d076353e0b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-sys\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-root\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.552871 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-accelerators-collector-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dfb8c91-f956-497e-8e6e-2cd3478bd805-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-wtmp\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.552991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-metrics-client-ca\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m62z9\" (UniqueName: \"kubernetes.io/projected/172233dc-4be5-4ca4-9250-0148f7f3f877-kube-api-access-m62z9\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx26c\" (UniqueName: \"kubernetes.io/projected/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-api-access-mx26c\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-textfile\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.553172 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxwrb\" (UniqueName: \"kubernetes.io/projected/fef97404-5e44-4b86-a436-13d076353e0b-kube-api-access-fxwrb\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.553469 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.553469 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.553469 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.553284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654317 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxwrb\" (UniqueName: \"kubernetes.io/projected/fef97404-5e44-4b86-a436-13d076353e0b-kube-api-access-fxwrb\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.654317 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef97404-5e44-4b86-a436-13d076353e0b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-sys\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654557 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:41.654546 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-root\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:41.654626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls podName:172233dc-4be5-4ca4-9250-0148f7f3f877 nodeName:}" failed. No retries permitted until 2026-06-12 17:41:42.15460583 +0000 UTC m=+251.191791515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls") pod "node-exporter-rccbj" (UID: "172233dc-4be5-4ca4-9250-0148f7f3f877") : secret "node-exporter-tls" not found Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-root\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-accelerators-collector-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dfb8c91-f956-497e-8e6e-2cd3478bd805-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:41.654733 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-wtmp\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:41:41.654781 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls podName:fef97404-5e44-4b86-a436-13d076353e0b nodeName:}" failed. No retries permitted until 2026-06-12 17:41:42.154765647 +0000 UTC m=+251.191951328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-kjp8r" (UID: "fef97404-5e44-4b86-a436-13d076353e0b") : secret "openshift-state-metrics-tls" not found Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-metrics-client-ca\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m62z9\" (UniqueName: \"kubernetes.io/projected/172233dc-4be5-4ca4-9250-0148f7f3f877-kube-api-access-m62z9\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-wtmp\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx26c\" (UniqueName: \"kubernetes.io/projected/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-api-access-mx26c\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.654915 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.654920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-textfile\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.655704 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.655217 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.655704 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.655239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-textfile\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.655704 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.655318 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172233dc-4be5-4ca4-9250-0148f7f3f877-sys\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.655857 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.655803 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.655912 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.655865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef97404-5e44-4b86-a436-13d076353e0b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.656179 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.656156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dfb8c91-f956-497e-8e6e-2cd3478bd805-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.657028 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.657007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-accelerators-collector-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.657241 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.657216 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172233dc-4be5-4ca4-9250-0148f7f3f877-metrics-client-ca\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.657672 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.657651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.658239 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.658216 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.658348 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.658216 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.658722 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.658704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.665385 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.665335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m62z9\" (UniqueName: \"kubernetes.io/projected/172233dc-4be5-4ca4-9250-0148f7f3f877-kube-api-access-m62z9\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:41.665920 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.665875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxwrb\" (UniqueName: \"kubernetes.io/projected/fef97404-5e44-4b86-a436-13d076353e0b-kube-api-access-fxwrb\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:41.668460 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.668430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx26c\" (UniqueName: \"kubernetes.io/projected/8dfb8c91-f956-497e-8e6e-2cd3478bd805-kube-api-access-mx26c\") pod \"kube-state-metrics-678bc549d7-4mr6h\" (UID: \"8dfb8c91-f956-497e-8e6e-2cd3478bd805\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.779333 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.779245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" Jun 12 17:41:41.915876 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:41.915841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h"] Jun 12 17:41:41.920208 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:41.920181 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfb8c91_f956_497e_8e6e_2cd3478bd805.slice/crio-d1be9d629e047d59d38d7ce9da2f5f769c69f77ca05c29992a1ac6a613c38a09 WatchSource:0}: Error finding container d1be9d629e047d59d38d7ce9da2f5f769c69f77ca05c29992a1ac6a613c38a09: Status 404 returned error can't find the container with id d1be9d629e047d59d38d7ce9da2f5f769c69f77ca05c29992a1ac6a613c38a09 Jun 12 17:41:42.159502 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.159423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:42.159668 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.159525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:42.162047 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.162022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172233dc-4be5-4ca4-9250-0148f7f3f877-node-exporter-tls\") pod \"node-exporter-rccbj\" (UID: \"172233dc-4be5-4ca4-9250-0148f7f3f877\") " pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:42.162142 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.162117 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef97404-5e44-4b86-a436-13d076353e0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kjp8r\" (UID: \"fef97404-5e44-4b86-a436-13d076353e0b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:42.257595 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.257562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" event={"ID":"8dfb8c91-f956-497e-8e6e-2cd3478bd805","Type":"ContainerStarted","Data":"d1be9d629e047d59d38d7ce9da2f5f769c69f77ca05c29992a1ac6a613c38a09"} Jun 12 17:41:42.259877 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.259858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:41:42.262210 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.262194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dde20f0e-471c-44f1-87ca-259faae3c93a-metrics-certs\") pod \"network-metrics-daemon-jqc8l\" (UID: \"dde20f0e-471c-44f1-87ca-259faae3c93a\") " pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:41:42.357708 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.357673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" Jun 12 17:41:42.371002 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.370965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rccbj" Jun 12 17:41:42.383765 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:42.383736 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172233dc_4be5_4ca4_9250_0148f7f3f877.slice/crio-357517fd3045f1972a2a53f115803b31eadbda340889243d978f31ec64d1fdc8 WatchSource:0}: Error finding container 357517fd3045f1972a2a53f115803b31eadbda340889243d978f31ec64d1fdc8: Status 404 returned error can't find the container with id 357517fd3045f1972a2a53f115803b31eadbda340889243d978f31ec64d1fdc8 Jun 12 17:41:42.495367 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.495335 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r"] Jun 12 17:41:42.499212 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:42.499177 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef97404_5e44_4b86_a436_13d076353e0b.slice/crio-1827963f5093c832853572158b1ab00aaea4b9ef7873c522aa08127126ba1d33 WatchSource:0}: Error finding container 1827963f5093c832853572158b1ab00aaea4b9ef7873c522aa08127126ba1d33: Status 404 returned error can't find the container with id 1827963f5093c832853572158b1ab00aaea4b9ef7873c522aa08127126ba1d33 Jun 12 17:41:42.543334 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.543280 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8p5z\"" Jun 12 17:41:42.551516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.551472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqc8l" Jun 12 17:41:42.709866 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:42.709769 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqc8l"] Jun 12 17:41:42.712643 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:42.712613 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde20f0e_471c_44f1_87ca_259faae3c93a.slice/crio-fdfe335dc406a981f77b2b74cbfd29bac08d9d15f8d1b102f3b549e09869b3d3 WatchSource:0}: Error finding container fdfe335dc406a981f77b2b74cbfd29bac08d9d15f8d1b102f3b549e09869b3d3: Status 404 returned error can't find the container with id fdfe335dc406a981f77b2b74cbfd29bac08d9d15f8d1b102f3b549e09869b3d3 Jun 12 17:41:43.262889 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:43.262843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rccbj" event={"ID":"172233dc-4be5-4ca4-9250-0148f7f3f877","Type":"ContainerStarted","Data":"357517fd3045f1972a2a53f115803b31eadbda340889243d978f31ec64d1fdc8"} Jun 12 17:41:43.264178 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:43.264148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqc8l" event={"ID":"dde20f0e-471c-44f1-87ca-259faae3c93a","Type":"ContainerStarted","Data":"fdfe335dc406a981f77b2b74cbfd29bac08d9d15f8d1b102f3b549e09869b3d3"} Jun 12 17:41:43.266199 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:43.266173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" event={"ID":"fef97404-5e44-4b86-a436-13d076353e0b","Type":"ContainerStarted","Data":"ece58a43b2aef1f06f10ca78ebb163f538d3e30f6f40be3d6222586ca8127162"} Jun 12 17:41:43.266302 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:43.266220 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" event={"ID":"fef97404-5e44-4b86-a436-13d076353e0b","Type":"ContainerStarted","Data":"1deeeb2d75d39786dd2d3e7f88eeb3d636744bd2a41dd39fced08ddaca9dcaf5"} Jun 12 17:41:43.266302 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:43.266240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" event={"ID":"fef97404-5e44-4b86-a436-13d076353e0b","Type":"ContainerStarted","Data":"1827963f5093c832853572158b1ab00aaea4b9ef7873c522aa08127126ba1d33"} Jun 12 17:41:44.272808 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:44.272698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" event={"ID":"8dfb8c91-f956-497e-8e6e-2cd3478bd805","Type":"ContainerStarted","Data":"1c07e5116d3e83579e9691469eaa06a6e110875372713e8abcc534be5a163e42"} Jun 12 17:41:44.275328 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:44.275143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rccbj" event={"ID":"172233dc-4be5-4ca4-9250-0148f7f3f877","Type":"ContainerStarted","Data":"eb515789792f6d7bf3a2f4f1e4cfbc0c7f1dea95263037892c3ec1d0077e5849"} Jun 12 17:41:44.284410 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:44.284108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" event={"ID":"fef97404-5e44-4b86-a436-13d076353e0b","Type":"ContainerStarted","Data":"4e6de1b5b41d2055e2e47d08d929f68c191f27997cf5320e79026689f3cf2891"} Jun 12 17:41:44.317111 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:44.316451 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kjp8r" podStartSLOduration=1.797824162 podStartE2EDuration="3.316427724s" totalImagesPullingTime="1.518603562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:44.314513541 +0000 UTC m=+253.351699257" watchObservedRunningTime="2026-06-12 17:41:44.316427724 +0000 UTC m=+253.353613420" Jun 12 17:41:45.290449 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.290414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" event={"ID":"8dfb8c91-f956-497e-8e6e-2cd3478bd805","Type":"ContainerStarted","Data":"1e61f93b19778e8e6733e384744bfa028f7b771b34cd74ea06a2ce7592f688a8"} Jun 12 17:41:45.290868 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.290468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" event={"ID":"8dfb8c91-f956-497e-8e6e-2cd3478bd805","Type":"ContainerStarted","Data":"d9b9b0b812204a04c6f5f1b4fc699c8cb41680805556133348559b0c194cae9b"} Jun 12 17:41:45.291787 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.291766 2581 generic.go:356] "Generic (PLEG): container finished" podID="172233dc-4be5-4ca4-9250-0148f7f3f877" containerID="eb515789792f6d7bf3a2f4f1e4cfbc0c7f1dea95263037892c3ec1d0077e5849" exitCode=0 Jun 12 17:41:45.291881 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.291856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rccbj" event={"ID":"172233dc-4be5-4ca4-9250-0148f7f3f877","Type":"ContainerDied","Data":"eb515789792f6d7bf3a2f4f1e4cfbc0c7f1dea95263037892c3ec1d0077e5849"} Jun 12 17:41:45.293515 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.293490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqc8l" event={"ID":"dde20f0e-471c-44f1-87ca-259faae3c93a","Type":"ContainerStarted","Data":"b12863680a696c7f98847c22a136d6bde21c06bbca49eac612e76e1fdfc6c9ec"} Jun 12 17:41:45.293609 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.293534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqc8l" event={"ID":"dde20f0e-471c-44f1-87ca-259faae3c93a","Type":"ContainerStarted","Data":"8931df2a3cea90615f7b306be7a93b3fa52486412ce7811cedc6f03ed9803c40"} Jun 12 17:41:45.312065 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.312023 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4mr6h" podStartSLOduration=2.064312845 podStartE2EDuration="4.312008958s" totalImagesPullingTime="2.247696113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:45.309666664 +0000 UTC m=+254.346852380" watchObservedRunningTime="2026-06-12 17:41:45.312008958 +0000 UTC m=+254.349194654" Jun 12 17:41:45.326117 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.326075 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jqc8l" podStartSLOduration=252.865444017 podStartE2EDuration="4m14.32606023s" totalImagesPullingTime="1.460616213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:45.325235611 +0000 UTC m=+254.362421303" watchObservedRunningTime="2026-06-12 17:41:45.32606023 +0000 UTC m=+254.363245917" Jun 12 17:41:45.829550 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.829514 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8569bdf54-l6s96"] Jun 12 17:41:45.831515 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.831499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.834048 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.834026 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 17:41:45.835198 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.835175 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 17:41:45.835646 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.835613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-85zkm\"" Jun 12 17:41:45.836494 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.836111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 17:41:45.836494 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.836156 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7n74pnbi9qt0g\"" Jun 12 17:41:45.836961 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.836713 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 17:41:45.846584 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.846562 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8569bdf54-l6s96"] Jun 12 17:41:45.993744 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-client-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.993744 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-client-certs\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.993968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-metrics-server-audit-profiles\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.993968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-tls\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.993968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.993968 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv57f\" (UniqueName: \"kubernetes.io/projected/cc7fa25d-56e9-46e5-ac49-279b4cb28607-kube-api-access-mv57f\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:45.994092 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:45.993977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc7fa25d-56e9-46e5-ac49-279b4cb28607-audit-log\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095144 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-client-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095144 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-client-certs\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095300 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-metrics-server-audit-profiles\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095332 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-tls\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095369 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095413 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv57f\" (UniqueName: \"kubernetes.io/projected/cc7fa25d-56e9-46e5-ac49-279b4cb28607-kube-api-access-mv57f\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095451 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc7fa25d-56e9-46e5-ac49-279b4cb28607-audit-log\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.095815 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.095788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc7fa25d-56e9-46e5-ac49-279b4cb28607-audit-log\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.096071 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.096051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.096260 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.096231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc7fa25d-56e9-46e5-ac49-279b4cb28607-metrics-server-audit-profiles\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.097829 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.097806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-client-certs\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.097912 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.097870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-client-ca-bundle\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.098168 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.098150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc7fa25d-56e9-46e5-ac49-279b4cb28607-secret-metrics-server-tls\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.103201 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.103183 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv57f\" (UniqueName: \"kubernetes.io/projected/cc7fa25d-56e9-46e5-ac49-279b4cb28607-kube-api-access-mv57f\") pod \"metrics-server-8569bdf54-l6s96\" (UID: \"cc7fa25d-56e9-46e5-ac49-279b4cb28607\") " pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.144966 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.144911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:41:46.287973 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.287949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8569bdf54-l6s96"] Jun 12 17:41:46.289505 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:46.289476 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7fa25d_56e9_46e5_ac49_279b4cb28607.slice/crio-90d153b94b9ce119e1ec9808fe46f509d3511826b14ff10cc7cce243b845cf12 WatchSource:0}: Error finding container 90d153b94b9ce119e1ec9808fe46f509d3511826b14ff10cc7cce243b845cf12: Status 404 returned error can't find the container with id 90d153b94b9ce119e1ec9808fe46f509d3511826b14ff10cc7cce243b845cf12 Jun 12 17:41:46.299563 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.299540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rccbj" event={"ID":"172233dc-4be5-4ca4-9250-0148f7f3f877","Type":"ContainerStarted","Data":"a8fd6b18c53cb9ac78f40c426ddea5766b7b4697dd29cd068fc1ecb765f734fa"} Jun 12 17:41:46.299914 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.299589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rccbj" event={"ID":"172233dc-4be5-4ca4-9250-0148f7f3f877","Type":"ContainerStarted","Data":"faae2824e6129734a0a8b7e8ff4e7921bb25813ae0e7d2cebe57fff5177c2d6a"} Jun 12 17:41:46.300766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.300742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" event={"ID":"cc7fa25d-56e9-46e5-ac49-279b4cb28607","Type":"ContainerStarted","Data":"90d153b94b9ce119e1ec9808fe46f509d3511826b14ff10cc7cce243b845cf12"} Jun 12 17:41:46.319229 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:46.319177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rccbj" podStartSLOduration=3.37129005 podStartE2EDuration="5.319162687s" totalImagesPullingTime="1.784279928s" totalInitContainerRuntime="163.592709ms" isStatefulPod=true podCreationTimestamp="2026-06-12 17:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:46.318136174 +0000 UTC m=+255.355321867" watchObservedRunningTime="2026-06-12 17:41:46.319162687 +0000 UTC m=+255.356348380" Jun 12 17:41:47.656389 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.656347 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:41:47.661002 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.660975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.663689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663664 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 17:41:47.663689 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663685 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 17:41:47.663906 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 17:41:47.663906 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663766 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 17:41:47.663906 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 17:41:47.664075 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.663914 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 17:41:47.664121 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.664108 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 17:41:47.664893 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.664876 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 17:41:47.665011 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.664877 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 17:41:47.665079 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72lr6\"" Jun 12 17:41:47.665079 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 17:41:47.665368 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665348 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 17:41:47.665623 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5d26dfqbtjh2\"" Jun 12 17:41:47.665623 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665451 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 17:41:47.665623 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.665472 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 17:41:47.666552 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.666533 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 17:41:47.676792 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.676765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:41:47.811047 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811219 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811219 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811219 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811219 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811219 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5574h\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811769 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.811769 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.811633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913034 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.912916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913034 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.912993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913034 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913034 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5574h\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.913359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.914042 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.913998 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.915269 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.915238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.915738 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.915714 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.916858 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.916831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.917165 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.917139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.917419 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.917399 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.917743 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.917726 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.918377 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.918355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.918846 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.918605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.918846 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.918778 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.919125 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.919104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.919360 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.919307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.919601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.919561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.919601 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.919589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.920068 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.920043 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.920325 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.920302 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.920473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.920454 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.921452 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.921419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.921869 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.921850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.922212 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.922192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5574h\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h\") pod \"prometheus-k8s-0\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:47.972077 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:47.972037 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:41:48.119615 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:48.119578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:41:48.123154 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:41:48.123112 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb224309_fe20_49ba_977a_99566371d5d6.slice/crio-8713d741adcb66d1530d1057624efdfde4b7d3fad2e1f605ef83825aaac3206d WatchSource:0}: Error finding container 8713d741adcb66d1530d1057624efdfde4b7d3fad2e1f605ef83825aaac3206d: Status 404 returned error can't find the container with id 8713d741adcb66d1530d1057624efdfde4b7d3fad2e1f605ef83825aaac3206d Jun 12 17:41:48.310249 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:48.310207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" event={"ID":"cc7fa25d-56e9-46e5-ac49-279b4cb28607","Type":"ContainerStarted","Data":"2ec6482825ee92059f6e8aa929f7b36ebbbb6ae6ee8da9c94a3493559614ccd4"} Jun 12 17:41:48.311334 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:48.311312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"8713d741adcb66d1530d1057624efdfde4b7d3fad2e1f605ef83825aaac3206d"} Jun 12 17:41:48.328685 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:48.328637 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" podStartSLOduration=1.90414826 podStartE2EDuration="3.328619805s" totalImagesPullingTime="1.424471545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:48.327074141 +0000 UTC m=+257.364259835" watchObservedRunningTime="2026-06-12 17:41:48.328619805 +0000 UTC m=+257.365805497" Jun 12 17:41:49.317070 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:49.316989 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" exitCode=0 Jun 12 17:41:49.317413 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:49.317079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} Jun 12 17:41:53.334247 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:53.334209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} Jun 12 17:41:53.334631 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:53.334291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} Jun 12 17:41:53.387680 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:53.387644 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:41:53.387841 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:53.387704 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:41:55.238993 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.238957 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:41:55.239349 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.239011 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:41:55.344913 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.344885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} Jun 12 17:41:55.345090 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.344970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} Jun 12 17:41:55.345090 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.345020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} Jun 12 17:41:55.345090 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.345050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerStarted","Data":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} Jun 12 17:41:55.376711 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:55.376658 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.449551321 podStartE2EDuration="8.376643457s" totalImagesPullingTime="5.908311414s" totalInitContainerRuntime="18.780722ms" isStatefulPod=false podCreationTimestamp="2026-06-12 17:41:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:41:55.374908514 +0000 UTC m=+264.412094208" watchObservedRunningTime="2026-06-12 17:41:55.376643457 +0000 UTC m=+264.413829182" Jun 12 17:41:57.972943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:41:57.972895 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:42:03.386114 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:03.386081 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:42:03.386559 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:03.386140 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:42:05.238633 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:05.238600 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:42:05.239036 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:05.238651 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:42:06.145758 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:06.145718 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:42:06.145965 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:06.145787 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:42:12.990116 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:42:12.990073 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7lnsw" podUID="bc17e1f7-bd48-4bc6-af52-5318f946462f" Jun 12 17:42:13.385719 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.385641 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:42:13.385719 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.385691 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:42:13.385889 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.385726 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:42:13.386238 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.386184 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"90856162edb8b13d742a6e06f9e46f3290e78f11dc7d1fc7001c8ff029517e22"} pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" containerMessage="Container registry failed liveness probe, will be restarted" Jun 12 17:42:13.389575 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.389547 2581 patch_prober.go:28] interesting pod/image-registry-789b5cf674-vrlsg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 17:42:13.389736 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.389631 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 17:42:13.415094 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:13.415066 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:16.672754 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:16.672718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:16.675231 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:16.675207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc17e1f7-bd48-4bc6-af52-5318f946462f-metrics-tls\") pod \"dns-default-7lnsw\" (UID: \"bc17e1f7-bd48-4bc6-af52-5318f946462f\") " pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:16.718759 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:16.718732 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7sb6x\"" Jun 12 17:42:16.727030 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:16.727008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:16.860316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:16.860292 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lnsw"] Jun 12 17:42:16.862421 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:42:16.862383 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc17e1f7_bd48_4bc6_af52_5318f946462f.slice/crio-4f5ffe0934b44a1296b64533312f01abb56d0be2059d487197deedf9a06c0ab6 WatchSource:0}: Error finding container 4f5ffe0934b44a1296b64533312f01abb56d0be2059d487197deedf9a06c0ab6: Status 404 returned error can't find the container with id 4f5ffe0934b44a1296b64533312f01abb56d0be2059d487197deedf9a06c0ab6 Jun 12 17:42:17.433001 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:17.432952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lnsw" event={"ID":"bc17e1f7-bd48-4bc6-af52-5318f946462f","Type":"ContainerStarted","Data":"4f5ffe0934b44a1296b64533312f01abb56d0be2059d487197deedf9a06c0ab6"} Jun 12 17:42:19.448908 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:19.448876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lnsw" event={"ID":"bc17e1f7-bd48-4bc6-af52-5318f946462f","Type":"ContainerStarted","Data":"1093755d3a24804339994cab514afe6e83ddf926dec27fbe2ce024356aca31ab"} Jun 12 17:42:19.449394 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:19.448941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lnsw" event={"ID":"bc17e1f7-bd48-4bc6-af52-5318f946462f","Type":"ContainerStarted","Data":"93e787d7bb4e178d898ecb5b092383f4a3b84016fb43ef40560531b904b92cea"} Jun 12 17:42:19.449394 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:19.449058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:19.468741 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:19.468683 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7lnsw" podStartSLOduration=251.605517968 podStartE2EDuration="4m13.468670434s" totalImagesPullingTime="1.863152466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:42:19.467518671 +0000 UTC m=+288.504704432" watchObservedRunningTime="2026-06-12 17:42:19.468670434 +0000 UTC m=+288.505856127" Jun 12 17:42:20.454421 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.454328 2581 generic.go:356] "Generic (PLEG): container finished" podID="5afeed3b-81c5-4f66-a92d-6dc43db97e5b" containerID="1ac95f52811cccadb0c8ec70eff2bcb3b6c28ed365f0c124d867f4559dafc8eb" exitCode=0 Jun 12 17:42:20.454421 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.454394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" event={"ID":"5afeed3b-81c5-4f66-a92d-6dc43db97e5b","Type":"ContainerDied","Data":"1ac95f52811cccadb0c8ec70eff2bcb3b6c28ed365f0c124d867f4559dafc8eb"} Jun 12 17:42:20.454848 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.454774 2581 scope.go:117] "RemoveContainer" containerID="1ac95f52811cccadb0c8ec70eff2bcb3b6c28ed365f0c124d867f4559dafc8eb" Jun 12 17:42:20.455923 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.455896 2581 generic.go:356] "Generic (PLEG): container finished" podID="8cb5156e-76f8-48b5-9651-4bd0cb9628c4" containerID="ec94425470921af6689bdbb62cdc35c71b1262ddb52ab6d3f354fe8a1c317eec" exitCode=0 Jun 12 17:42:20.456062 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.455954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" event={"ID":"8cb5156e-76f8-48b5-9651-4bd0cb9628c4","Type":"ContainerDied","Data":"ec94425470921af6689bdbb62cdc35c71b1262ddb52ab6d3f354fe8a1c317eec"} Jun 12 17:42:20.456396 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:20.456376 2581 scope.go:117] "RemoveContainer" containerID="ec94425470921af6689bdbb62cdc35c71b1262ddb52ab6d3f354fe8a1c317eec" Jun 12 17:42:21.462253 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:21.462218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gvfz7" event={"ID":"5afeed3b-81c5-4f66-a92d-6dc43db97e5b","Type":"ContainerStarted","Data":"cc1c05979fdfb7d010e9c2ee758a4fc7100fd41f84cb644679d3bd0a542accf0"} Jun 12 17:42:21.463954 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:21.463912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s6svl" event={"ID":"8cb5156e-76f8-48b5-9651-4bd0cb9628c4","Type":"ContainerStarted","Data":"4faca34e1cfdebb3b62931cdbc8634ec87f3aafe041168ea733b93bb38735337"} Jun 12 17:42:23.390792 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:23.390766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:42:26.150803 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:26.150773 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:42:26.154703 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:26.154679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8569bdf54-l6s96" Jun 12 17:42:29.458702 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:29.458677 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7lnsw" Jun 12 17:42:31.397392 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:31.397363 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:42:31.397392 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:31.397383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:42:31.401586 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:31.401565 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 17:42:38.406606 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:38.406555 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" podUID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerName="registry" containerID="cri-o://90856162edb8b13d742a6e06f9e46f3290e78f11dc7d1fc7001c8ff029517e22" gracePeriod=30 Jun 12 17:42:39.543910 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:39.543882 2581 generic.go:356] "Generic (PLEG): container finished" podID="6154f5d4-b81f-401e-bc0b-a3f7278bdf1e" containerID="90856162edb8b13d742a6e06f9e46f3290e78f11dc7d1fc7001c8ff029517e22" exitCode=0 Jun 12 17:42:39.544228 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:39.543942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" event={"ID":"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e","Type":"ContainerDied","Data":"90856162edb8b13d742a6e06f9e46f3290e78f11dc7d1fc7001c8ff029517e22"} Jun 12 17:42:40.549718 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:40.549689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" event={"ID":"6154f5d4-b81f-401e-bc0b-a3f7278bdf1e","Type":"ContainerStarted","Data":"5a9e6b53459a093c41748e55e7c666d069e37e5f68a0d30fa82b753f825fc1ef"} Jun 12 17:42:40.550131 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:40.549797 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:42:47.972256 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:47.972221 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:42:47.988798 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:47.988772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:42:48.597653 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:42:48.597627 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:01.559045 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:01.559013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-789b5cf674-vrlsg" Jun 12 17:43:06.025444 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025406 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025704 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="prometheus" containerID="cri-o://3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" gracePeriod=600 Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025733 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy" containerID="cri-o://ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" gracePeriod=600 Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025761 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="thanos-sidecar" containerID="cri-o://08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" gracePeriod=600 Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025797 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="config-reloader" containerID="cri-o://dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" gracePeriod=600 Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025767 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" gracePeriod=600 Jun 12 17:43:06.025888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.025772 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-web" containerID="cri-o://4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" gracePeriod=600 Jun 12 17:43:06.268536 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.268513 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.419859 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.419824 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.419867 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.419901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.419923 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.419983 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420044 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420042 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420099 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420135 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420173 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420201 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420262 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420286 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420350 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420429 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420452 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5574h\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.420706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420475 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs\") pod \"fb224309-fe20-49ba-977a-99566371d5d6\" (UID: \"fb224309-fe20-49ba-977a-99566371d5d6\") " Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420342 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423501 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420697 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.420717 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.421020 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.423573 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423046 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423574 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423815 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423241 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423405 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.423464 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.424034 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config" (OuterVolumeSpecName: "config") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.424291 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out" (OuterVolumeSpecName: "config-out") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 17:43:06.424553 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.424543 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 17:43:06.425007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.424590 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 17:43:06.425581 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.425553 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.425974 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.425955 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h" (OuterVolumeSpecName: "kube-api-access-5574h") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "kube-api-access-5574h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 17:43:06.426246 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.426230 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.426735 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.426706 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.435463 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.435429 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config" (OuterVolumeSpecName: "web-config") pod "fb224309-fe20-49ba-977a-99566371d5d6" (UID: "fb224309-fe20-49ba-977a-99566371d5d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 17:43:06.522285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522250 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522280 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522290 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-web-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522300 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-config-out\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522308 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-metrics-client-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522316 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522326 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522335 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-db\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522344 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-grpc-tls\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522353 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522361 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522370 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-kube-rbac-proxy\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522380 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5574h\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-kube-api-access-5574h\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522388 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-metrics-client-certs\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522397 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb224309-fe20-49ba-977a-99566371d5d6-tls-assets\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522404 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb224309-fe20-49ba-977a-99566371d5d6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522412 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522421 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522430 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.522504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.522438 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb224309-fe20-49ba-977a-99566371d5d6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653716 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" exitCode=0 Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653740 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" exitCode=0 Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653746 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" exitCode=0 Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653752 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" exitCode=0 Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653757 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" exitCode=0 Jun 12 17:43:06.653748 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653762 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb224309-fe20-49ba-977a-99566371d5d6" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" exitCode=0 Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653795 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653959 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.653995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.654037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.654077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} Jun 12 17:43:06.654124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.654123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} Jun 12 17:43:06.654460 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.654164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb224309-fe20-49ba-977a-99566371d5d6","Type":"ContainerDied","Data":"8713d741adcb66d1530d1057624efdfde4b7d3fad2e1f605ef83825aaac3206d"} Jun 12 17:43:06.662941 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.662909 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.670596 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.670575 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.677444 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.677426 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.681167 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.681143 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:06.685067 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.685050 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.688196 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.688176 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:06.692862 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.692845 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.700022 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.700006 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.706957 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.706902 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.707258 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.707235 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.707333 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707266 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.707333 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707285 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.707574 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.707531 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.707610 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707581 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.707610 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707597 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.707817 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.707801 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.707858 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707824 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.707858 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.707840 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.708090 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.708073 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.708138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708096 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.708138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708111 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.708331 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.708309 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.708374 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708335 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.708374 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708347 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.708578 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.708563 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.708619 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708584 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.708619 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708598 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.708827 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:43:06.708811 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.708877 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708831 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.708877 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.708845 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.709176 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709159 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.709226 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709177 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.709396 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709380 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.709435 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709398 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.709641 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709624 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.709683 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709641 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.709859 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709843 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.709904 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.709860 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.710084 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710066 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.710135 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710084 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.710294 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710279 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.710337 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710294 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.710501 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710485 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.710544 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710502 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.710683 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710668 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.710721 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710684 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.710895 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710881 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.710960 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.710896 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.711098 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711082 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.711098 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711097 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.711289 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711275 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.711351 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711289 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.711504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711484 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.711548 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711514 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.711724 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711705 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.711771 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711726 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.711966 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711944 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.712025 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.711968 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.712220 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712203 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.712261 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712221 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.712436 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712419 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.712487 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712437 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.712634 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712613 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.712679 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712634 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.712812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712796 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.712849 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.712812 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.713017 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713001 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.713072 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713018 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.713223 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713207 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.713263 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713223 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.713414 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713395 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.713504 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713414 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.713637 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713620 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.713683 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713637 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.713825 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713808 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.713888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.713827 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.714100 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714085 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.714147 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714101 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.714294 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714277 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.714340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714295 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.714513 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714496 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.714572 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714517 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.714744 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714726 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.714797 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714744 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.714962 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714946 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.715013 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.714962 2581 scope.go:117] "RemoveContainer" containerID="17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b" Jun 12 17:43:06.715192 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715170 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b"} err="failed to get container status \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": rpc error: code = NotFound desc = could not find container \"17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b\": container with ID starting with 17a432a69a8ebe7e83c0ab3d776ed17b611e0e028d5448c8ee0ffeea9899551b not found: ID does not exist" Jun 12 17:43:06.715244 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715201 2581 scope.go:117] "RemoveContainer" containerID="ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b" Jun 12 17:43:06.715435 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715419 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b"} err="failed to get container status \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": rpc error: code = NotFound desc = could not find container \"ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b\": container with ID starting with ea2ea11a6534705c658faafe209c57c602ea7d1984b009909e93612dc9faf70b not found: ID does not exist" Jun 12 17:43:06.715476 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715436 2581 scope.go:117] "RemoveContainer" containerID="4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16" Jun 12 17:43:06.715648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715632 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16"} err="failed to get container status \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": rpc error: code = NotFound desc = could not find container \"4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16\": container with ID starting with 4213532ae54cdaa1f39c4c34e318998ce16dfe4381409eb95599ec9921b36e16 not found: ID does not exist" Jun 12 17:43:06.715648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715648 2581 scope.go:117] "RemoveContainer" containerID="08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac" Jun 12 17:43:06.715857 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715840 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac"} err="failed to get container status \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": rpc error: code = NotFound desc = could not find container \"08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac\": container with ID starting with 08296491730a4969b4d0a0994b39c0a0c04ed235ae65aec4cddb0ebf9ade39ac not found: ID does not exist" Jun 12 17:43:06.715895 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.715857 2581 scope.go:117] "RemoveContainer" containerID="dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809" Jun 12 17:43:06.716082 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.716067 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809"} err="failed to get container status \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": rpc error: code = NotFound desc = could not find container \"dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809\": container with ID starting with dbca75b417291e955b6a428c2736ff60f63d5b6051bd7761921948c502652809 not found: ID does not exist" Jun 12 17:43:06.716082 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.716082 2581 scope.go:117] "RemoveContainer" containerID="3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67" Jun 12 17:43:06.716284 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.716267 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67"} err="failed to get container status \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": rpc error: code = NotFound desc = could not find container \"3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67\": container with ID starting with 3a37e583d1d77ab3ea2a1f8808282387a076552b62ec22a28652ac57572c3f67 not found: ID does not exist" Jun 12 17:43:06.716324 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.716288 2581 scope.go:117] "RemoveContainer" containerID="285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22" Jun 12 17:43:06.716483 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.716464 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22"} err="failed to get container status \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": rpc error: code = NotFound desc = could not find container \"285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22\": container with ID starting with 285d63ad4ee5c804f5838f56d48d0302273ceb63a1243133c7a1e6e6e37ccf22 not found: ID does not exist" Jun 12 17:43:06.719971 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.719952 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:06.720237 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720224 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="init-config-reloader" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720238 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="init-config-reloader" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720246 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="prometheus" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720252 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="prometheus" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720261 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="thanos-sidecar" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720266 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="thanos-sidecar" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720272 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-thanos" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720277 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-thanos" Jun 12 17:43:06.720283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720284 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="config-reloader" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720290 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="config-reloader" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720297 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720303 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720312 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-web" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720317 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-web" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720359 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-thanos" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720367 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720373 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="thanos-sidecar" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720379 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="prometheus" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720385 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="kube-rbac-proxy-web" Jun 12 17:43:06.720535 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.720390 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb224309-fe20-49ba-977a-99566371d5d6" containerName="config-reloader" Jun 12 17:43:06.725754 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.725740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.728648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 17:43:06.728648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728641 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 17:43:06.728812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 17:43:06.728812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 17:43:06.728812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728725 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 17:43:06.728812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.728728 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 17:43:06.729022 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729009 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 17:43:06.729063 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729012 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 17:43:06.729105 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5d26dfqbtjh2\"" Jun 12 17:43:06.729234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729217 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 17:43:06.729234 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72lr6\"" Jun 12 17:43:06.729369 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 17:43:06.729457 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729440 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 17:43:06.729581 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.729565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 17:43:06.737759 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.735514 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 17:43:06.740110 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.739945 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 17:43:06.742506 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.742487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:06.825150 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825150 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqz6p\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-kube-api-access-fqz6p\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825343 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825343 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825343 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825343 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825465 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825465 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825465 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825465 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825589 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825589 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825589 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825677 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825677 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825677 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.825852 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.825769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926594 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926594 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926594 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqz6p\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-kube-api-access-fqz6p\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.926864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.926739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927188 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927444 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927444 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927786 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927786 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927581 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927786 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.927786 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928007 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.927983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928254 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.928037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928254 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.928062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928254 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.928085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.928254 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.928126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.930225 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.929949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.930225 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.930050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.930225 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.930049 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.930225 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.930105 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.930624 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.930599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.931087 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.931057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.931661 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.931478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.931661 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.931536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.931661 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.931614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.931844 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.931758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.932065 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.932047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.932594 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.932576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.932943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.932914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.933426 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.933410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:06.935859 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:06.935843 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqz6p\" (UniqueName: \"kubernetes.io/projected/3c0fb1b8-4ba6-449e-bf4d-b21949f8585b-kube-api-access-fqz6p\") pod \"prometheus-k8s-0\" (UID: \"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:07.039205 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.039171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:43:07.184848 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.184774 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 17:43:07.188708 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:43:07.188682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0fb1b8_4ba6_449e_bf4d_b21949f8585b.slice/crio-8ae6bfb34d1d45400b3b8f21e6f36614edc5154dee80b13a9ae3545c2fd8931f WatchSource:0}: Error finding container 8ae6bfb34d1d45400b3b8f21e6f36614edc5154dee80b13a9ae3545c2fd8931f: Status 404 returned error can't find the container with id 8ae6bfb34d1d45400b3b8f21e6f36614edc5154dee80b13a9ae3545c2fd8931f Jun 12 17:43:07.443895 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.443815 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb224309-fe20-49ba-977a-99566371d5d6" path="/var/lib/kubelet/pods/fb224309-fe20-49ba-977a-99566371d5d6/volumes" Jun 12 17:43:07.659520 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.659486 2581 generic.go:356] "Generic (PLEG): container finished" podID="3c0fb1b8-4ba6-449e-bf4d-b21949f8585b" containerID="39850af2c46f1e4b21f2b954355ad81067d92e20b731f2e01e311908015418d1" exitCode=0 Jun 12 17:43:07.659655 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.659522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerDied","Data":"39850af2c46f1e4b21f2b954355ad81067d92e20b731f2e01e311908015418d1"} Jun 12 17:43:07.659655 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:07.659584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"8ae6bfb34d1d45400b3b8f21e6f36614edc5154dee80b13a9ae3545c2fd8931f"} Jun 12 17:43:08.666663 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"6840de4917d1362a7d5977ac7c491331d1dfffafe89ba0a43ef274ac03cb9ac7"} Jun 12 17:43:08.667050 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"27cbb64982394c94b63b0eb118007223d093f7e5ae98f5ea5e140ebdf7aa6c6e"} Jun 12 17:43:08.667050 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666715 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"9fd40cd62e3b555af0b4784c3b258cce343f1e39b49f614f8fe6f9c4addbb84d"} Jun 12 17:43:08.667050 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"7d71e0cafb4b42241739a75eca0e998d42d8d62405934ac9ac656ce9ddeed65b"} Jun 12 17:43:08.667050 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"dfd172fe1d61597b1969b05271b88774d1b2cb95c020109d56b265b362e14826"} Jun 12 17:43:08.667050 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.666794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0fb1b8-4ba6-449e-bf4d-b21949f8585b","Type":"ContainerStarted","Data":"1765c8875ebcfb3f0e38667c81f9bca15032eb1620a720d2431147ec900c15bf"} Jun 12 17:43:08.699582 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:08.699527 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.677737592 podStartE2EDuration="2.69951009s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.772498ms" isStatefulPod=false podCreationTimestamp="2026-06-12 17:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:43:08.697801283 +0000 UTC m=+337.734987009" watchObservedRunningTime="2026-06-12 17:43:08.69951009 +0000 UTC m=+337.736695836" Jun 12 17:43:12.039399 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:43:12.039315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:44:07.039800 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:44:07.039762 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:44:07.056020 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:44:07.055984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:44:07.908839 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:44:07.908813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 17:46:27.343707 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.343669 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd"] Jun 12 17:46:27.346989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.346969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.349590 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.349557 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 17:46:27.349731 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.349617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 17:46:27.349731 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.349638 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 17:46:27.349731 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.349636 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 17:46:27.349731 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.349626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mcdqh\"" Jun 12 17:46:27.373293 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.373267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd"] Jun 12 17:46:27.455706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.455675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.455901 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.455730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-tmp\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.455901 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.455767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.455901 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.455801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhpqj\" (UniqueName: \"kubernetes.io/projected/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-kube-api-access-vhpqj\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.455901 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.455830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-manifests\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557032 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.556994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.557048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-tmp\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.557082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.557119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhpqj\" (UniqueName: \"kubernetes.io/projected/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-kube-api-access-vhpqj\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557232 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.557148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-manifests\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.557564 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.557542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-manifests\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.559688 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.559663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-tmp\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.559688 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.559681 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.559853 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.559836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.565688 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.565664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhpqj\" (UniqueName: \"kubernetes.io/projected/da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73-kube-api-access-vhpqj\") pod \"opendatahub-operator-controller-manager-78cd4b5f47-ld9dd\" (UID: \"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73\") " pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.657559 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.657459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:27.803314 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.803290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd"] Jun 12 17:46:27.804977 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:46:27.804948 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5ec992_ac6a_4cbd_89fa_f88cf5b3bf73.slice/crio-39f46028e0ce7a4b670f8212b96f3de665aaea71763543a36cb0b9f59bfbc72f WatchSource:0}: Error finding container 39f46028e0ce7a4b670f8212b96f3de665aaea71763543a36cb0b9f59bfbc72f: Status 404 returned error can't find the container with id 39f46028e0ce7a4b670f8212b96f3de665aaea71763543a36cb0b9f59bfbc72f Jun 12 17:46:27.806714 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:27.806694 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 17:46:28.451492 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:28.451427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" event={"ID":"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73","Type":"ContainerStarted","Data":"39f46028e0ce7a4b670f8212b96f3de665aaea71763543a36cb0b9f59bfbc72f"} Jun 12 17:46:31.466632 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:31.466597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" event={"ID":"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73","Type":"ContainerStarted","Data":"1cad45fca095011b9e93e9b0df4c55ab19243ffcb4712072f8366275d6aa49f6"} Jun 12 17:46:32.472663 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:32.472626 2581 generic.go:356] "Generic (PLEG): container finished" podID="da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73" containerID="1cad45fca095011b9e93e9b0df4c55ab19243ffcb4712072f8366275d6aa49f6" exitCode=0 Jun 12 17:46:32.473076 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:32.472689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" event={"ID":"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73","Type":"ContainerDied","Data":"1cad45fca095011b9e93e9b0df4c55ab19243ffcb4712072f8366275d6aa49f6"} Jun 12 17:46:33.478185 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:33.478141 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" event={"ID":"da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73","Type":"ContainerStarted","Data":"7d2b362e5036e886cc9ad607c5b431babfbd005e90d8ca40b5b2a170a60c4573"} Jun 12 17:46:33.478657 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:33.478224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:33.501324 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:33.501281 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" podStartSLOduration=2.29105843 podStartE2EDuration="6.50126687s" totalImagesPullingTime="3.253721108s" totalInitContainerRuntime="956.487332ms" isStatefulPod=false podCreationTimestamp="2026-06-12 17:46:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:46:33.499618524 +0000 UTC m=+542.536804210" watchObservedRunningTime="2026-06-12 17:46:33.50126687 +0000 UTC m=+542.538452616" Jun 12 17:46:44.485526 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:44.485498 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78cd4b5f47-ld9dd" Jun 12 17:46:46.931919 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.931883 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd"] Jun 12 17:46:46.936737 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.936720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:46.940386 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.940361 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 17:46:46.941468 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.941439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 17:46:46.941607 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.941501 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mw4tf\"" Jun 12 17:46:46.949900 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:46.949878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd"] Jun 12 17:46:47.022982 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.022946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2ca501-777f-4c37-ae32-95ed942cec8b-tls-certs\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.023174 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.023093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2ca501-777f-4c37-ae32-95ed942cec8b-tmp\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.023174 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.023145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rz45\" (UniqueName: \"kubernetes.io/projected/ae2ca501-777f-4c37-ae32-95ed942cec8b-kube-api-access-8rz45\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.123566 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.123534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2ca501-777f-4c37-ae32-95ed942cec8b-tls-certs\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.123754 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.123617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2ca501-777f-4c37-ae32-95ed942cec8b-tmp\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.123754 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.123646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rz45\" (UniqueName: \"kubernetes.io/projected/ae2ca501-777f-4c37-ae32-95ed942cec8b-kube-api-access-8rz45\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.126223 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.126195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2ca501-777f-4c37-ae32-95ed942cec8b-tls-certs\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.126544 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.126523 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2ca501-777f-4c37-ae32-95ed942cec8b-tmp\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.136385 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.136362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rz45\" (UniqueName: \"kubernetes.io/projected/ae2ca501-777f-4c37-ae32-95ed942cec8b-kube-api-access-8rz45\") pod \"kube-auth-proxy-5f5b76d6b9-2p8sd\" (UID: \"ae2ca501-777f-4c37-ae32-95ed942cec8b\") " pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.246876 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.246002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" Jun 12 17:46:47.427947 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.427910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd"] Jun 12 17:46:47.430629 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:46:47.430605 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2ca501_777f_4c37_ae32_95ed942cec8b.slice/crio-fb891d1ea281c7bbf85567d7e4c63b3a789bdb83dd7f8acada9ee0371580ef5d WatchSource:0}: Error finding container fb891d1ea281c7bbf85567d7e4c63b3a789bdb83dd7f8acada9ee0371580ef5d: Status 404 returned error can't find the container with id fb891d1ea281c7bbf85567d7e4c63b3a789bdb83dd7f8acada9ee0371580ef5d Jun 12 17:46:47.541022 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.540908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" event={"ID":"ae2ca501-777f-4c37-ae32-95ed942cec8b","Type":"ContainerStarted","Data":"fb891d1ea281c7bbf85567d7e4c63b3a789bdb83dd7f8acada9ee0371580ef5d"} Jun 12 17:46:47.914671 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.914602 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ps96w"] Jun 12 17:46:47.917977 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.917958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:47.920755 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.920736 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 17:46:47.931116 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.931094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85c7s\" (UniqueName: \"kubernetes.io/projected/e02ae075-302b-4d1e-a440-997da22760f1-kube-api-access-85c7s\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:47.931217 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.931165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:47.938747 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:47.938724 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ps96w"] Jun 12 17:46:48.032385 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.032348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:48.032570 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.032495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85c7s\" (UniqueName: \"kubernetes.io/projected/e02ae075-302b-4d1e-a440-997da22760f1-kube-api-access-85c7s\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:48.032681 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:46:48.032661 2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 12 17:46:48.032746 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:46:48.032735 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs podName:e02ae075-302b-4d1e-a440-997da22760f1 nodeName:}" failed. No retries permitted until 2026-06-12 17:46:48.532716947 +0000 UTC m=+557.569902618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs") pod "model-serving-api-5dd488fc48-ps96w" (UID: "e02ae075-302b-4d1e-a440-997da22760f1") : secret "model-serving-api-tls" not found Jun 12 17:46:48.051290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.051234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85c7s\" (UniqueName: \"kubernetes.io/projected/e02ae075-302b-4d1e-a440-997da22760f1-kube-api-access-85c7s\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:48.537781 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.537739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:48.540301 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.540270 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e02ae075-302b-4d1e-a440-997da22760f1-tls-certs\") pod \"model-serving-api-5dd488fc48-ps96w\" (UID: \"e02ae075-302b-4d1e-a440-997da22760f1\") " pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:48.828322 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:48.828232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:49.598652 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:49.598627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ps96w"] Jun 12 17:46:49.600582 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:46:49.600555 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02ae075_302b_4d1e_a440_997da22760f1.slice/crio-044b14adb594020910819888271303f71b11501ea3df66b6bac68e964d1b6a3e WatchSource:0}: Error finding container 044b14adb594020910819888271303f71b11501ea3df66b6bac68e964d1b6a3e: Status 404 returned error can't find the container with id 044b14adb594020910819888271303f71b11501ea3df66b6bac68e964d1b6a3e Jun 12 17:46:50.557241 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:50.557206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" event={"ID":"ae2ca501-777f-4c37-ae32-95ed942cec8b","Type":"ContainerStarted","Data":"b83faa4d8955705da695669deccde1b1d96f08edfcd1a4814cebd3669a9703f8"} Jun 12 17:46:50.558509 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:50.558485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" event={"ID":"e02ae075-302b-4d1e-a440-997da22760f1","Type":"ContainerStarted","Data":"044b14adb594020910819888271303f71b11501ea3df66b6bac68e964d1b6a3e"} Jun 12 17:46:50.578539 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:50.578451 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f5b76d6b9-2p8sd" podStartSLOduration=1.686671977 podStartE2EDuration="4.578437909s" totalImagesPullingTime="2.891765932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:46:50.577738727 +0000 UTC m=+559.614924420" watchObservedRunningTime="2026-06-12 17:46:50.578437909 +0000 UTC m=+559.615623601" Jun 12 17:46:52.567942 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:52.567892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" event={"ID":"e02ae075-302b-4d1e-a440-997da22760f1","Type":"ContainerStarted","Data":"2bba393ef1898f8ffffc9d0a7fbec0d539814464cfda7fddb6b5afec8f75050a"} Jun 12 17:46:52.568396 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:52.568022 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:46:52.587579 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:52.587522 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" podStartSLOduration=3.629014677 podStartE2EDuration="5.587507572s" totalImagesPullingTime="1.958492895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:46:52.585593802 +0000 UTC m=+561.622779476" watchObservedRunningTime="2026-06-12 17:46:52.587507572 +0000 UTC m=+561.624693266" Jun 12 17:46:57.728290 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.728254 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-62rm9"] Jun 12 17:46:57.732374 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.732357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.735211 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.735192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 17:46:57.735318 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.735210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jwtwd\"" Jun 12 17:46:57.740703 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.740679 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn"] Jun 12 17:46:57.744480 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.744461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.745519 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.745497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-62rm9"] Jun 12 17:46:57.747163 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.747098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 17:46:57.747267 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.747192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kcx2j\"" Jun 12 17:46:57.751859 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.751771 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn"] Jun 12 17:46:57.823815 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.823787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxg6\" (UniqueName: \"kubernetes.io/projected/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-kube-api-access-6lxg6\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.824018 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.823828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.824018 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.823851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfq8d\" (UniqueName: \"kubernetes.io/projected/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-kube-api-access-nfq8d\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.824018 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.823875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.925399 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.925367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxg6\" (UniqueName: \"kubernetes.io/projected/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-kube-api-access-6lxg6\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.925567 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.925425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.925567 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.925461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfq8d\" (UniqueName: \"kubernetes.io/projected/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-kube-api-access-nfq8d\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.925567 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.925486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.925697 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:46:57.925612 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 12 17:46:57.925697 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:46:57.925673 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert podName:7dbfaa4c-35fb-41e6-9dba-51fd51b017e8 nodeName:}" failed. No retries permitted until 2026-06-12 17:46:58.42565441 +0000 UTC m=+567.462840086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert") pod "kserve-controller-manager-69fc866d76-62rm9" (UID: "7dbfaa4c-35fb-41e6-9dba-51fd51b017e8") : secret "kserve-webhook-server-cert" not found Jun 12 17:46:57.927905 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.927882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:57.942128 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.942099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxg6\" (UniqueName: \"kubernetes.io/projected/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-kube-api-access-6lxg6\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:57.942514 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:57.942498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfq8d\" (UniqueName: \"kubernetes.io/projected/c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1-kube-api-access-nfq8d\") pod \"llmisvc-controller-manager-864bfd7bc9-9ndnn\" (UID: \"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:58.055514 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.055415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:46:58.200459 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.200434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn"] Jun 12 17:46:58.202857 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:46:58.202836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc1e4e9e1_62a9_4768_9c5b_ea4f8bfecef1.slice/crio-d91965071af12747807b423d712aee8761da7404f469414ce8df7d2d6ab62336 WatchSource:0}: Error finding container d91965071af12747807b423d712aee8761da7404f469414ce8df7d2d6ab62336: Status 404 returned error can't find the container with id d91965071af12747807b423d712aee8761da7404f469414ce8df7d2d6ab62336 Jun 12 17:46:58.431376 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.431345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:58.433864 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.433844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dbfaa4c-35fb-41e6-9dba-51fd51b017e8-cert\") pod \"kserve-controller-manager-69fc866d76-62rm9\" (UID: \"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:58.600207 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.600176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" event={"ID":"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1","Type":"ContainerStarted","Data":"d91965071af12747807b423d712aee8761da7404f469414ce8df7d2d6ab62336"} Jun 12 17:46:58.645157 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.645125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:46:58.807276 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:58.807198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-62rm9"] Jun 12 17:46:58.828306 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:46:58.828273 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbfaa4c_35fb_41e6_9dba_51fd51b017e8.slice/crio-0498e8a947d27d31ccda4b9d43fbe8319fd5686e840b51eff981332c56f2a157 WatchSource:0}: Error finding container 0498e8a947d27d31ccda4b9d43fbe8319fd5686e840b51eff981332c56f2a157: Status 404 returned error can't find the container with id 0498e8a947d27d31ccda4b9d43fbe8319fd5686e840b51eff981332c56f2a157 Jun 12 17:46:59.610725 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:46:59.610682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" event={"ID":"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8","Type":"ContainerStarted","Data":"0498e8a947d27d31ccda4b9d43fbe8319fd5686e840b51eff981332c56f2a157"} Jun 12 17:47:02.627469 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.627429 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" event={"ID":"7dbfaa4c-35fb-41e6-9dba-51fd51b017e8","Type":"ContainerStarted","Data":"3043f4925f3a60792e3849d7b326897a3181e1c79eb38bcbc71eaa03fdbe51ed"} Jun 12 17:47:02.627962 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.627572 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:47:02.629154 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.629132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" event={"ID":"c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1","Type":"ContainerStarted","Data":"056defd3b7613da0000f9f97ac91142dbc28dff376db355dcfcbddd9508341b5"} Jun 12 17:47:02.629275 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.629259 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:47:02.662898 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.662831 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" podStartSLOduration=2.443034119 podStartE2EDuration="5.662811712s" totalImagesPullingTime="3.219777593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:47:02.662726225 +0000 UTC m=+571.699911919" watchObservedRunningTime="2026-06-12 17:47:02.662811712 +0000 UTC m=+571.699997405" Jun 12 17:47:02.688958 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:02.688878 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" podStartSLOduration=1.845449512 podStartE2EDuration="5.688857219s" totalImagesPullingTime="3.843407707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:47:02.686314192 +0000 UTC m=+571.723499887" watchObservedRunningTime="2026-06-12 17:47:02.688857219 +0000 UTC m=+571.726042913" Jun 12 17:47:03.578551 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.578517 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-ps96w" Jun 12 17:47:03.832202 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.832120 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gwssv"] Jun 12 17:47:03.835616 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.835599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:03.854823 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.854797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 17:47:03.855000 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.854826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-9fzbc\"" Jun 12 17:47:03.871165 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.871138 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 17:47:03.892703 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.892664 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gwssv"] Jun 12 17:47:03.988348 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.988318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458rh\" (UniqueName: \"kubernetes.io/projected/38eccf95-25b3-41c3-ad85-acd6de370b4a-kube-api-access-458rh\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:03.988522 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:03.988355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/38eccf95-25b3-41c3-ad85-acd6de370b4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.026128 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.026099 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c4d8df475-w8c8w"] Jun 12 17:47:04.029545 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.029520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.033874 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.033853 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w28gn\"" Jun 12 17:47:04.034742 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.034725 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 17:47:04.072624 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.072594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c4d8df475-w8c8w"] Jun 12 17:47:04.089190 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.089118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458rh\" (UniqueName: \"kubernetes.io/projected/38eccf95-25b3-41c3-ad85-acd6de370b4a-kube-api-access-458rh\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.089190 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.089174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/38eccf95-25b3-41c3-ad85-acd6de370b4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.091795 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.091769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/38eccf95-25b3-41c3-ad85-acd6de370b4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.104308 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.104288 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-458rh\" (UniqueName: \"kubernetes.io/projected/38eccf95-25b3-41c3-ad85-acd6de370b4a-kube-api-access-458rh\") pod \"servicemesh-operator3-57f65f65fb-gwssv\" (UID: \"38eccf95-25b3-41c3-ad85-acd6de370b4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.145334 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.145293 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:04.190637 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.190604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wd6l\" (UniqueName: \"kubernetes.io/projected/ddc5097b-ea77-4e98-b48d-1d0a82e50738-kube-api-access-8wd6l\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.190812 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.190668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ddc5097b-ea77-4e98-b48d-1d0a82e50738-redirect-config\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.291550 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.291519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wd6l\" (UniqueName: \"kubernetes.io/projected/ddc5097b-ea77-4e98-b48d-1d0a82e50738-kube-api-access-8wd6l\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.291714 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.291565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ddc5097b-ea77-4e98-b48d-1d0a82e50738-redirect-config\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.292285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.292267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ddc5097b-ea77-4e98-b48d-1d0a82e50738-redirect-config\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.305756 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.305729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wd6l\" (UniqueName: \"kubernetes.io/projected/ddc5097b-ea77-4e98-b48d-1d0a82e50738-kube-api-access-8wd6l\") pod \"dashboard-redirect-7c4d8df475-w8c8w\" (UID: \"ddc5097b-ea77-4e98-b48d-1d0a82e50738\") " pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.339037 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.338996 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" Jun 12 17:47:04.341170 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.341099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gwssv"] Jun 12 17:47:04.347034 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:47:04.347008 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eccf95_25b3_41c3_ad85_acd6de370b4a.slice/crio-2f857e2f83044748c01b61010b5a424027d6168f6eeb3eed559f2dcd62262886 WatchSource:0}: Error finding container 2f857e2f83044748c01b61010b5a424027d6168f6eeb3eed559f2dcd62262886: Status 404 returned error can't find the container with id 2f857e2f83044748c01b61010b5a424027d6168f6eeb3eed559f2dcd62262886 Jun 12 17:47:04.493200 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.493166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c4d8df475-w8c8w"] Jun 12 17:47:04.496438 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:47:04.496412 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc5097b_ea77_4e98_b48d_1d0a82e50738.slice/crio-ee36028209ff48e48cc9570e2f4d8441c9a786c939a1c74d0551c24a71da221e WatchSource:0}: Error finding container ee36028209ff48e48cc9570e2f4d8441c9a786c939a1c74d0551c24a71da221e: Status 404 returned error can't find the container with id ee36028209ff48e48cc9570e2f4d8441c9a786c939a1c74d0551c24a71da221e Jun 12 17:47:04.639060 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.638958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" event={"ID":"ddc5097b-ea77-4e98-b48d-1d0a82e50738","Type":"ContainerStarted","Data":"ee36028209ff48e48cc9570e2f4d8441c9a786c939a1c74d0551c24a71da221e"} Jun 12 17:47:04.640404 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:04.640385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" event={"ID":"38eccf95-25b3-41c3-ad85-acd6de370b4a","Type":"ContainerStarted","Data":"2f857e2f83044748c01b61010b5a424027d6168f6eeb3eed559f2dcd62262886"} Jun 12 17:47:07.658845 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:07.658808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" event={"ID":"38eccf95-25b3-41c3-ad85-acd6de370b4a","Type":"ContainerStarted","Data":"eb6f831677217f90557f5c7200b80a74df03a9af9f149b3e34ea52902fff614f"} Jun 12 17:47:07.659299 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:07.658947 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:07.681844 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:07.681797 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" podStartSLOduration=2.028646748 podStartE2EDuration="4.681781431s" totalImagesPullingTime="2.653134683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:47:07.678644638 +0000 UTC m=+576.715830358" watchObservedRunningTime="2026-06-12 17:47:07.681781431 +0000 UTC m=+576.718967125" Jun 12 17:47:08.666220 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:08.666188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" event={"ID":"ddc5097b-ea77-4e98-b48d-1d0a82e50738","Type":"ContainerStarted","Data":"09e1d8eaca87bf888bcea78e7d56d8e1c846b0f9b848aeb0d2716232a728767c"} Jun 12 17:47:08.684989 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:08.684914 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c4d8df475-w8c8w" podStartSLOduration=1.87598726 podStartE2EDuration="5.684897215s" totalImagesPullingTime="3.808909955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:47:08.684417969 +0000 UTC m=+577.721603663" watchObservedRunningTime="2026-06-12 17:47:08.684897215 +0000 UTC m=+577.722082909" Jun 12 17:47:18.669361 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:18.669331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gwssv" Jun 12 17:47:31.270300 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.270261 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv"] Jun 12 17:47:31.285120 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.285080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.287002 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.286979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv"] Jun 12 17:47:31.288198 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.288174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xqzmv\"" Jun 12 17:47:31.288313 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.288173 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 17:47:31.288313 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.288183 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 17:47:31.288313 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.288184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 17:47:31.288464 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.288211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 17:47:31.340081 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340081 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69879\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-kube-api-access-69879\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/837bd67f-9310-431a-83dd-9afb244573f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.340340 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.340298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.435702 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.435679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:47:31.435702 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.435687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:47:31.441124 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441449 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69879\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-kube-api-access-69879\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441449 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/837bd67f-9310-431a-83dd-9afb244573f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.441449 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.441387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.443919 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.443897 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 17:47:31.444098 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.443973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 17:47:31.444098 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.443899 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 17:47:31.444098 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.444081 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/837bd67f-9310-431a-83dd-9afb244573f0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.444281 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.444165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 17:47:31.449845 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.449821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.450055 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.450033 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69879\" (UniqueName: \"kubernetes.io/projected/837bd67f-9310-431a-83dd-9afb244573f0-kube-api-access-69879\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.452275 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.452253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.453826 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.453806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.454909 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.454888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.455025 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.454996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/837bd67f-9310-431a-83dd-9afb244573f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-blnwv\" (UID: \"837bd67f-9310-431a-83dd-9afb244573f0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.598774 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.598690 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xqzmv\"" Jun 12 17:47:31.606903 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.606883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:31.753959 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.753908 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv"] Jun 12 17:47:31.757370 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:47:31.757342 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837bd67f_9310_431a_83dd_9afb244573f0.slice/crio-5d7b055815b6d4d3fbef99c8c72228f8d106cf0a74298252b012a620f1e96607 WatchSource:0}: Error finding container 5d7b055815b6d4d3fbef99c8c72228f8d106cf0a74298252b012a620f1e96607: Status 404 returned error can't find the container with id 5d7b055815b6d4d3fbef99c8c72228f8d106cf0a74298252b012a620f1e96607 Jun 12 17:47:31.775272 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:31.775246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" event={"ID":"837bd67f-9310-431a-83dd-9afb244573f0","Type":"ContainerStarted","Data":"5d7b055815b6d4d3fbef99c8c72228f8d106cf0a74298252b012a620f1e96607"} Jun 12 17:47:33.635732 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:33.635696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9ndnn" Jun 12 17:47:33.639077 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:33.639050 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-62rm9" Jun 12 17:47:34.184594 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:34.184552 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 12 17:47:34.184684 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:34.184642 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 12 17:47:34.791256 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:34.791222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" event={"ID":"837bd67f-9310-431a-83dd-9afb244573f0","Type":"ContainerStarted","Data":"d8a78e7ebbb55971bda31961c863a692685a59bc737274d332eecf99b5a6c01e"} Jun 12 17:47:34.791622 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:34.791284 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:47:34.813644 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:34.813587 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" podStartSLOduration=1.388836855 podStartE2EDuration="3.813559642s" totalImagesPullingTime="2.424722787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:47:34.811136236 +0000 UTC m=+603.848321942" watchObservedRunningTime="2026-06-12 17:47:34.813559642 +0000 UTC m=+603.850745336" Jun 12 17:47:35.797617 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:47:35.797587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-blnwv" Jun 12 17:48:19.056503 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.056466 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6fcng"] Jun 12 17:48:19.060191 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.060170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:19.062944 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.062912 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 17:48:19.063061 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.062951 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 17:48:19.063061 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.063035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8kjhk\"" Jun 12 17:48:19.069315 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.069290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6fcng"] Jun 12 17:48:19.182204 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.182172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8krhv\" (UniqueName: \"kubernetes.io/projected/06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a-kube-api-access-8krhv\") pod \"authorino-operator-75cc8d5cb7-6fcng\" (UID: \"06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:19.282874 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.282841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8krhv\" (UniqueName: \"kubernetes.io/projected/06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a-kube-api-access-8krhv\") pod \"authorino-operator-75cc8d5cb7-6fcng\" (UID: \"06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:19.291507 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.291473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8krhv\" (UniqueName: \"kubernetes.io/projected/06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a-kube-api-access-8krhv\") pod \"authorino-operator-75cc8d5cb7-6fcng\" (UID: \"06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:19.370706 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.370629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:19.509655 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:19.509631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6fcng"] Jun 12 17:48:19.512086 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:48:19.512056 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a8bdfe_b6c2_4e37_ba5b_8a6968219a0a.slice/crio-7a32153508ab0e832322f64bfcb2d9e7ebc3261fcaf379ba4d462d7129f59947 WatchSource:0}: Error finding container 7a32153508ab0e832322f64bfcb2d9e7ebc3261fcaf379ba4d462d7129f59947: Status 404 returned error can't find the container with id 7a32153508ab0e832322f64bfcb2d9e7ebc3261fcaf379ba4d462d7129f59947 Jun 12 17:48:20.002183 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:20.002151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" event={"ID":"06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a","Type":"ContainerStarted","Data":"7a32153508ab0e832322f64bfcb2d9e7ebc3261fcaf379ba4d462d7129f59947"} Jun 12 17:48:22.023000 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:22.022965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" event={"ID":"06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a","Type":"ContainerStarted","Data":"c0e7dcf26d7a66e3dcc130ab051dea72c0bcad7b2f78d0fdd62788c7a3a28acc"} Jun 12 17:48:22.023387 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:22.023060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:22.040202 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:22.040152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" podStartSLOduration=0.738380695 podStartE2EDuration="3.040132703s" totalImagesPullingTime="2.301752008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:48:22.03878158 +0000 UTC m=+651.075967274" watchObservedRunningTime="2026-06-12 17:48:22.040132703 +0000 UTC m=+651.077318399" Jun 12 17:48:33.030061 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:33.030026 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6fcng" Jun 12 17:48:43.785507 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.785476 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk"] Jun 12 17:48:43.788904 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.788887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.791663 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.791640 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wd865\"" Jun 12 17:48:43.806519 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.806491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.806668 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.806574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqfvz\" (UniqueName: \"kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.807263 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.807234 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk"] Jun 12 17:48:43.907372 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.907335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqfvz\" (UniqueName: \"kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.907547 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.907413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.907762 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.907746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.916008 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.915975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqfvz\" (UniqueName: \"kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.951035 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.950995 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk"] Jun 12 17:48:43.951339 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.951323 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:43.957999 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.957959 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk"] Jun 12 17:48:43.979116 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.979083 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst"] Jun 12 17:48:43.983605 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.983578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:43.998644 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:43.998611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst"] Jun 12 17:48:44.008305 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.008279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19c606ad-47f6-4bf8-bbed-808a031452f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.008459 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.008401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gkv\" (UniqueName: \"kubernetes.io/projected/19c606ad-47f6-4bf8-bbed-808a031452f1-kube-api-access-p4gkv\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.109104 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.109008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gkv\" (UniqueName: \"kubernetes.io/projected/19c606ad-47f6-4bf8-bbed-808a031452f1-kube-api-access-p4gkv\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.109104 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.109068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19c606ad-47f6-4bf8-bbed-808a031452f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.109405 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.109388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19c606ad-47f6-4bf8-bbed-808a031452f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.117318 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.117291 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gkv\" (UniqueName: \"kubernetes.io/projected/19c606ad-47f6-4bf8-bbed-808a031452f1-kube-api-access-p4gkv\") pod \"kuadrant-operator-controller-manager-86878c769f-5vcst\" (UID: \"19c606ad-47f6-4bf8-bbed-808a031452f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.296392 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.296360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:44.434133 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:44.434101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst"] Jun 12 17:48:44.437179 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:48:44.437149 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c606ad_47f6_4bf8_bbed_808a031452f1.slice/crio-fc6bcdc8d05fee5c95267b546e6535e0cb682e5f90a30ff4b34ebbf893d44e5c WatchSource:0}: Error finding container fc6bcdc8d05fee5c95267b546e6535e0cb682e5f90a30ff4b34ebbf893d44e5c: Status 404 returned error can't find the container with id fc6bcdc8d05fee5c95267b546e6535e0cb682e5f90a30ff4b34ebbf893d44e5c Jun 12 17:48:45.135820 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:45.135776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" event={"ID":"19c606ad-47f6-4bf8-bbed-808a031452f1","Type":"ContainerStarted","Data":"fc6bcdc8d05fee5c95267b546e6535e0cb682e5f90a30ff4b34ebbf893d44e5c"} Jun 12 17:48:46.500876 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:48:46.500828 2581 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-86878c769f-kvtdk_kuadrant-system_8808cb8b-3c3d-4c20-afac-964153308dda_0(b8bb75607ac7dd9700aa953fe9681f5049bc149b0a3841843be29b7eb5c361b1): error adding pod kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kvtdk to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 12 17:48:46.501258 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:48:46.500911 2581 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-86878c769f-kvtdk_kuadrant-system_8808cb8b-3c3d-4c20-afac-964153308dda_0(b8bb75607ac7dd9700aa953fe9681f5049bc149b0a3841843be29b7eb5c361b1): error adding pod kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kvtdk to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:47.146393 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.146361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:47.155764 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.155733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:47.157951 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:48:47.157904 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" is forbidden: User \"system:node:ip-10-0-129-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-69.ec2.internal' and this object" podUID="8808cb8b-3c3d-4c20-afac-964153308dda" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:47.235943 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.235906 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume\") pod \"8808cb8b-3c3d-4c20-afac-964153308dda\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " Jun 12 17:48:47.236122 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.236006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqfvz\" (UniqueName: \"kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz\") pod \"8808cb8b-3c3d-4c20-afac-964153308dda\" (UID: \"8808cb8b-3c3d-4c20-afac-964153308dda\") " Jun 12 17:48:47.236229 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.236200 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8808cb8b-3c3d-4c20-afac-964153308dda" (UID: "8808cb8b-3c3d-4c20-afac-964153308dda"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 17:48:47.238590 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.238565 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz" (OuterVolumeSpecName: "kube-api-access-lqfvz") pod "8808cb8b-3c3d-4c20-afac-964153308dda" (UID: "8808cb8b-3c3d-4c20-afac-964153308dda"). InnerVolumeSpecName "kube-api-access-lqfvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 17:48:47.337046 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.337009 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8808cb8b-3c3d-4c20-afac-964153308dda-extensions-socket-volume\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:48:47.337046 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.337039 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqfvz\" (UniqueName: \"kubernetes.io/projected/8808cb8b-3c3d-4c20-afac-964153308dda-kube-api-access-lqfvz\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 12 17:48:47.447029 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:47.446997 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8808cb8b-3c3d-4c20-afac-964153308dda" path="/var/lib/kubelet/pods/8808cb8b-3c3d-4c20-afac-964153308dda/volumes" Jun 12 17:48:48.152216 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:48.152172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:48.156727 ip-10-0-129-69 kubenswrapper[2581]: E0612 17:48:48.156693 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kvtdk\" is forbidden: User \"system:node:ip-10-0-129-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-69.ec2.internal' and this object" podUID="8808cb8b-3c3d-4c20-afac-964153308dda" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvtdk" Jun 12 17:48:50.165457 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:50.165420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" event={"ID":"19c606ad-47f6-4bf8-bbed-808a031452f1","Type":"ContainerStarted","Data":"19d5bc330d88713f308e55fd3d4fe23ffd8d5ca6f6db20ea05037816b22e2078"} Jun 12 17:48:50.165889 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:50.165542 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:48:50.186248 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:48:50.186192 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" podStartSLOduration=2.331056991 podStartE2EDuration="7.186176831s" totalImagesPullingTime="4.85511984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:48:50.184665094 +0000 UTC m=+679.221850803" watchObservedRunningTime="2026-06-12 17:48:50.186176831 +0000 UTC m=+679.223362523" Jun 12 17:49:01.172958 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:01.172910 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vcst" Jun 12 17:49:40.683726 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.683697 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-7qwn4"] Jun 12 17:49:40.688789 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.688767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.691177 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.691147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 17:49:40.697343 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.697319 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7qwn4"] Jun 12 17:49:40.815842 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.815809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgswk\" (UniqueName: \"kubernetes.io/projected/913e65bd-7d50-4055-95a9-ff787c009792-kube-api-access-fgswk\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.816030 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.815899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/913e65bd-7d50-4055-95a9-ff787c009792-data\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.917279 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.917243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgswk\" (UniqueName: \"kubernetes.io/projected/913e65bd-7d50-4055-95a9-ff787c009792-kube-api-access-fgswk\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.917475 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.917394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/913e65bd-7d50-4055-95a9-ff787c009792-data\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.917772 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.917752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/913e65bd-7d50-4055-95a9-ff787c009792-data\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:40.926180 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:40.926153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgswk\" (UniqueName: \"kubernetes.io/projected/913e65bd-7d50-4055-95a9-ff787c009792-kube-api-access-fgswk\") pod \"postgres-69fb4594cf-7qwn4\" (UID: \"913e65bd-7d50-4055-95a9-ff787c009792\") " pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:41.000129 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:41.000041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:41.135103 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:41.135076 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7qwn4"] Jun 12 17:49:41.137233 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:49:41.137205 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913e65bd_7d50_4055_95a9_ff787c009792.slice/crio-a2db976e8f8db46d951310f6b6e4ccfbbb6ae061bee093f2a1b2b56f65d75ae8 WatchSource:0}: Error finding container a2db976e8f8db46d951310f6b6e4ccfbbb6ae061bee093f2a1b2b56f65d75ae8: Status 404 returned error can't find the container with id a2db976e8f8db46d951310f6b6e4ccfbbb6ae061bee093f2a1b2b56f65d75ae8 Jun 12 17:49:41.417736 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:41.417706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7qwn4" event={"ID":"913e65bd-7d50-4055-95a9-ff787c009792","Type":"ContainerStarted","Data":"a2db976e8f8db46d951310f6b6e4ccfbbb6ae061bee093f2a1b2b56f65d75ae8"} Jun 12 17:49:44.435156 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:44.435115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7qwn4" event={"ID":"913e65bd-7d50-4055-95a9-ff787c009792","Type":"ContainerStarted","Data":"928a5adfa93e5dc3d3f9d0c234dda40d59cb40448bd6a421aa3521af5823291d"} Jun 12 17:49:44.435614 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:44.435198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:49:44.456100 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:44.456055 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-7qwn4" podStartSLOduration=2.194928583 podStartE2EDuration="4.456039735s" totalImagesPullingTime="2.261111152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:49:44.454290652 +0000 UTC m=+733.491476347" watchObservedRunningTime="2026-06-12 17:49:44.456039735 +0000 UTC m=+733.493225428" Jun 12 17:49:50.472658 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:49:50.472629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-7qwn4" Jun 12 17:51:25.976486 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:25.976450 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2vp5h"] Jun 12 17:51:25.978766 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:25.978748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:25.982551 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:25.982529 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 17:51:25.983091 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:25.983071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kw29g\"" Jun 12 17:51:25.988510 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:25.988490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2vp5h"] Jun 12 17:51:26.026418 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.024211 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-qrtw7"] Jun 12 17:51:26.027914 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.027887 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-qrtw7"] Jun 12 17:51:26.028047 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.028013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:26.074832 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.074793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56kxs\" (UniqueName: \"kubernetes.io/projected/328a7a60-8b82-4147-b0ef-703617a21901-kube-api-access-56kxs\") pod \"payload-pre-processing-579785bc64-2vp5h\" (UID: \"328a7a60-8b82-4147-b0ef-703617a21901\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:26.175815 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.175786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56kxs\" (UniqueName: \"kubernetes.io/projected/328a7a60-8b82-4147-b0ef-703617a21901-kube-api-access-56kxs\") pod \"payload-pre-processing-579785bc64-2vp5h\" (UID: \"328a7a60-8b82-4147-b0ef-703617a21901\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:26.176012 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.175858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwdqb\" (UniqueName: \"kubernetes.io/projected/2fe63091-17ae-4900-9d45-2c1b910ed44c-kube-api-access-mwdqb\") pod \"payload-processing-699b6cd6c-qrtw7\" (UID: \"2fe63091-17ae-4900-9d45-2c1b910ed44c\") " pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:26.184097 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.184068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56kxs\" (UniqueName: \"kubernetes.io/projected/328a7a60-8b82-4147-b0ef-703617a21901-kube-api-access-56kxs\") pod \"payload-pre-processing-579785bc64-2vp5h\" (UID: \"328a7a60-8b82-4147-b0ef-703617a21901\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:26.277268 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.277171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwdqb\" (UniqueName: \"kubernetes.io/projected/2fe63091-17ae-4900-9d45-2c1b910ed44c-kube-api-access-mwdqb\") pod \"payload-processing-699b6cd6c-qrtw7\" (UID: \"2fe63091-17ae-4900-9d45-2c1b910ed44c\") " pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:26.286604 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.286578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwdqb\" (UniqueName: \"kubernetes.io/projected/2fe63091-17ae-4900-9d45-2c1b910ed44c-kube-api-access-mwdqb\") pod \"payload-processing-699b6cd6c-qrtw7\" (UID: \"2fe63091-17ae-4900-9d45-2c1b910ed44c\") " pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:26.290392 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.290369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:26.339516 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.339475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:26.442283 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.442238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2vp5h"] Jun 12 17:51:26.445174 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:51:26.445145 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328a7a60_8b82_4147_b0ef_703617a21901.slice/crio-67639beec4d93e0bdcfcb9cb587f27dadb2c89f81db516e9db98adcb5ae7713c WatchSource:0}: Error finding container 67639beec4d93e0bdcfcb9cb587f27dadb2c89f81db516e9db98adcb5ae7713c: Status 404 returned error can't find the container with id 67639beec4d93e0bdcfcb9cb587f27dadb2c89f81db516e9db98adcb5ae7713c Jun 12 17:51:26.490344 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.490320 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-qrtw7"] Jun 12 17:51:26.492388 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:51:26.492358 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe63091_17ae_4900_9d45_2c1b910ed44c.slice/crio-1cca47302828e92c153e377dd71e4e6971ab0fcd1c3b0189e9f0a15886f2bb9d WatchSource:0}: Error finding container 1cca47302828e92c153e377dd71e4e6971ab0fcd1c3b0189e9f0a15886f2bb9d: Status 404 returned error can't find the container with id 1cca47302828e92c153e377dd71e4e6971ab0fcd1c3b0189e9f0a15886f2bb9d Jun 12 17:51:26.932568 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.932530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" event={"ID":"2fe63091-17ae-4900-9d45-2c1b910ed44c","Type":"ContainerStarted","Data":"1cca47302828e92c153e377dd71e4e6971ab0fcd1c3b0189e9f0a15886f2bb9d"} Jun 12 17:51:26.933744 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:26.933719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" event={"ID":"328a7a60-8b82-4147-b0ef-703617a21901","Type":"ContainerStarted","Data":"67639beec4d93e0bdcfcb9cb587f27dadb2c89f81db516e9db98adcb5ae7713c"} Jun 12 17:51:28.946731 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.946695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" event={"ID":"2fe63091-17ae-4900-9d45-2c1b910ed44c","Type":"ContainerStarted","Data":"db0c8eba99c8b5563b721c2de80b97b22f6694fdce58b02d0046ba332fe2d40e"} Jun 12 17:51:28.947203 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.946796 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:28.948625 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.948572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" event={"ID":"328a7a60-8b82-4147-b0ef-703617a21901","Type":"ContainerStarted","Data":"cb54376d7064067c17cb93aa6880db67bec9e6cd1459beab6f221fd9016606af"} Jun 12 17:51:28.948767 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.948721 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:51:28.963888 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.963841 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" podStartSLOduration=1.607428825 podStartE2EDuration="3.963825243s" totalImagesPullingTime="2.356396418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:51:28.963452683 +0000 UTC m=+838.000638377" watchObservedRunningTime="2026-06-12 17:51:28.963825243 +0000 UTC m=+838.001010938" Jun 12 17:51:28.981045 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:28.980993 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" podStartSLOduration=1.590576615 podStartE2EDuration="3.980978589s" totalImagesPullingTime="2.390401974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:51:28.979263909 +0000 UTC m=+838.016449600" watchObservedRunningTime="2026-06-12 17:51:28.980978589 +0000 UTC m=+838.018164282" Jun 12 17:51:39.957770 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:39.957741 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-qrtw7" Jun 12 17:51:39.958161 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:51:39.957809 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2vp5h" Jun 12 17:52:31.466242 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:52:31.466214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:52:31.467345 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:52:31.467321 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:54:30.592877 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.592843 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj"] Jun 12 17:54:30.597097 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.597076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.600893 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.600870 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jt8zq\"" Jun 12 17:54:30.601036 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.600870 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 17:54:30.601036 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.600870 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 17:54:30.601036 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.600870 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 17:54:30.610225 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.609062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj"] Jun 12 17:54:30.720544 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxzn\" (UniqueName: \"kubernetes.io/projected/4d4d747a-c737-4ea8-b013-db0bc635634a-kube-api-access-6fxzn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.720745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d4d747a-c737-4ea8-b013-db0bc635634a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.720745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.720745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.720745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.720745 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.720730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822141 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822141 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxzn\" (UniqueName: \"kubernetes.io/projected/4d4d747a-c737-4ea8-b013-db0bc635634a-kube-api-access-6fxzn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822359 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d4d747a-c737-4ea8-b013-db0bc635634a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822637 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822616 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822678 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822602 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.822719 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.822666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.824698 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.824674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d4d747a-c737-4ea8-b013-db0bc635634a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.825138 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.825118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d4d747a-c737-4ea8-b013-db0bc635634a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.830550 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.830524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxzn\" (UniqueName: \"kubernetes.io/projected/4d4d747a-c737-4ea8-b013-db0bc635634a-kube-api-access-6fxzn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj\" (UID: \"4d4d747a-c737-4ea8-b013-db0bc635634a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:30.910728 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:30.910643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:31.052959 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:31.052905 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj"] Jun 12 17:54:31.055335 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:54:31.055307 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4d747a_c737_4ea8_b013_db0bc635634a.slice/crio-9dd06173179a42483ab6b0f514cc1471ccbb9439b552f1ecd66c572e2f3e2de8 WatchSource:0}: Error finding container 9dd06173179a42483ab6b0f514cc1471ccbb9439b552f1ecd66c572e2f3e2de8: Status 404 returned error can't find the container with id 9dd06173179a42483ab6b0f514cc1471ccbb9439b552f1ecd66c572e2f3e2de8 Jun 12 17:54:31.057316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:31.057299 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 17:54:31.846498 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:31.846453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" event={"ID":"4d4d747a-c737-4ea8-b013-db0bc635634a","Type":"ContainerStarted","Data":"9dd06173179a42483ab6b0f514cc1471ccbb9439b552f1ecd66c572e2f3e2de8"} Jun 12 17:54:35.874127 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:35.874091 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" event={"ID":"4d4d747a-c737-4ea8-b013-db0bc635634a","Type":"ContainerStarted","Data":"1b559db2d090ab86c6560ca861d471e844800869686f9d10ad0e7fd78b558102"} Jun 12 17:54:36.881043 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:36.881007 2581 generic.go:356] "Generic (PLEG): container finished" podID="4d4d747a-c737-4ea8-b013-db0bc635634a" containerID="1b559db2d090ab86c6560ca861d471e844800869686f9d10ad0e7fd78b558102" exitCode=0 Jun 12 17:54:36.881513 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:36.881103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" event={"ID":"4d4d747a-c737-4ea8-b013-db0bc635634a","Type":"ContainerDied","Data":"1b559db2d090ab86c6560ca861d471e844800869686f9d10ad0e7fd78b558102"} Jun 12 17:54:38.893311 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:38.893275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" event={"ID":"4d4d747a-c737-4ea8-b013-db0bc635634a","Type":"ContainerStarted","Data":"230a50365a41886ee86089cb7f31abd07ffebe40f6b11047d77050fc10c1859b"} Jun 12 17:54:38.913252 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:38.913205 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" podStartSLOduration=2.690577248 podStartE2EDuration="8.913191083s" totalImagesPullingTime="4.954989483s" totalInitContainerRuntime="1.267624352s" isStatefulPod=false podCreationTimestamp="2026-06-12 17:54:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:54:38.911216241 +0000 UTC m=+1027.948401935" watchObservedRunningTime="2026-06-12 17:54:38.913191083 +0000 UTC m=+1027.950376775" Jun 12 17:54:40.910821 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:40.910791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:40.911216 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:40.910846 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:40.923818 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:40.923794 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:54:41.920031 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:54:41.919991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj" Jun 12 17:57:31.496460 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:57:31.496428 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:57:31.498642 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:57:31.498611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6lks_54ab72db-d7c6-4ff3-a171-0409446c6d0c/ovn-acl-logging/0.log" Jun 12 17:59:26.046496 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.046463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c4d8df475-w8c8w_ddc5097b-ea77-4e98-b48d-1d0a82e50738/nginx/0.log" Jun 12 17:59:26.154853 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.154828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-62rm9_7dbfaa4c-35fb-41e6-9dba-51fd51b017e8/manager/0.log" Jun 12 17:59:26.264605 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.264576 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9ndnn_c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1/manager/0.log" Jun 12 17:59:26.594424 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.594398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ps96w_e02ae075-302b-4d1e-a440-997da22760f1/server/0.log" Jun 12 17:59:26.938803 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.938774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cd4b5f47-ld9dd_da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73/manager/0.log" Jun 12 17:59:26.944699 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:26.944672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cd4b5f47-ld9dd_da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73/copy-manifests/0.log" Jun 12 17:59:27.164184 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:27.164155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7qwn4_913e65bd-7d50-4055-95a9-ff787c009792/postgres/0.log" Jun 12 17:59:28.491483 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:28.491449 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6fcng_06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a/manager/0.log" Jun 12 17:59:28.943865 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:28.943834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5vcst_19c606ad-47f6-4bf8-bbed-808a031452f1/manager/0.log" Jun 12 17:59:29.663942 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:29.663898 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-blnwv_837bd67f-9310-431a-83dd-9afb244573f0/discovery/0.log" Jun 12 17:59:29.828320 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:29.828289 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5b76d6b9-2p8sd_ae2ca501-777f-4c37-ae32-95ed942cec8b/kube-auth-proxy/0.log" Jun 12 17:59:30.162759 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:30.162726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2vp5h_328a7a60-8b82-4147-b0ef-703617a21901/payload-pre-processing/0.log" Jun 12 17:59:30.268083 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:30.268052 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-qrtw7_2fe63091-17ae-4900-9d45-2c1b910ed44c/payload-processing/0.log" Jun 12 17:59:30.381373 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:30.381340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6cc649d-9zh9g_a348a5e7-8064-4361-8ef7-3a70f88dd904/router/0.log" Jun 12 17:59:30.702869 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:30.702837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj_4d4d747a-c737-4ea8-b013-db0bc635634a/storage-initializer/0.log" Jun 12 17:59:30.709707 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:30.709687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-8stkj_4d4d747a-c737-4ea8-b013-db0bc635634a/main/0.log" Jun 12 17:59:38.670648 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:38.670622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9vjtb_dc1a2667-2314-4331-a789-b42dddd53616/global-pull-secret-syncer/0.log" Jun 12 17:59:38.804975 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:38.804939 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxnq5_5ac2b97a-86ca-45a1-b6f1-7844589381bd/konnectivity-agent/0.log" Jun 12 17:59:38.882700 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:38.882668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-69.ec2.internal_e6cc1eeeda5c676493db83fa5936c2f7/haproxy/0.log" Jun 12 17:59:42.660186 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:42.660103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-gwssv_38eccf95-25b3-41c3-ad85-acd6de370b4a/sail-operator/0.log" Jun 12 17:59:44.291118 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:44.291083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6fcng_06a8bdfe-b6c2-4e37-ba5b-8a6968219a0a/manager/0.log" Jun 12 17:59:44.426668 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:44.426637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5vcst_19c606ad-47f6-4bf8-bbed-808a031452f1/manager/0.log" Jun 12 17:59:46.588684 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.588594 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4mr6h_8dfb8c91-f956-497e-8e6e-2cd3478bd805/kube-state-metrics/0.log" Jun 12 17:59:46.628713 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.628689 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4mr6h_8dfb8c91-f956-497e-8e6e-2cd3478bd805/kube-rbac-proxy-main/0.log" Jun 12 17:59:46.660637 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.660601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4mr6h_8dfb8c91-f956-497e-8e6e-2cd3478bd805/kube-rbac-proxy-self/0.log" Jun 12 17:59:46.694740 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.694706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8569bdf54-l6s96_cc7fa25d-56e9-46e5-ac49-279b4cb28607/metrics-server/0.log" Jun 12 17:59:46.880379 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.880306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rccbj_172233dc-4be5-4ca4-9250-0148f7f3f877/node-exporter/0.log" Jun 12 17:59:46.904830 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.904805 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rccbj_172233dc-4be5-4ca4-9250-0148f7f3f877/kube-rbac-proxy/0.log" Jun 12 17:59:46.933987 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:46.933968 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rccbj_172233dc-4be5-4ca4-9250-0148f7f3f877/init-textfile/0.log" Jun 12 17:59:47.070857 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.070832 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kjp8r_fef97404-5e44-4b86-a436-13d076353e0b/kube-rbac-proxy-main/0.log" Jun 12 17:59:47.094692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.094668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kjp8r_fef97404-5e44-4b86-a436-13d076353e0b/kube-rbac-proxy-self/0.log" Jun 12 17:59:47.118760 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.118733 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kjp8r_fef97404-5e44-4b86-a436-13d076353e0b/openshift-state-metrics/0.log" Jun 12 17:59:47.159157 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.159088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/prometheus/0.log" Jun 12 17:59:47.184869 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.184844 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/config-reloader/0.log" Jun 12 17:59:47.212692 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.212661 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/thanos-sidecar/0.log" Jun 12 17:59:47.249872 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.249846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/kube-rbac-proxy-web/0.log" Jun 12 17:59:47.277177 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.277146 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/kube-rbac-proxy/0.log" Jun 12 17:59:47.310797 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.310758 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/kube-rbac-proxy-thanos/0.log" Jun 12 17:59:47.333799 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.333772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c0fb1b8-4ba6-449e-bf4d-b21949f8585b/init-config-reloader/0.log" Jun 12 17:59:47.416720 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:47.416698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-wtdkl_9094fd3f-3813-4d46-8541-7ea6a8db8c1c/prometheus-operator-admission-webhook/0.log" Jun 12 17:59:50.134583 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.134551 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x"] Jun 12 17:59:50.138316 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.138296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.140767 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.140744 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zwfp\"/\"openshift-service-ca.crt\"" Jun 12 17:59:50.141843 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.141826 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zwfp\"/\"kube-root-ca.crt\"" Jun 12 17:59:50.141950 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.141831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6zwfp\"/\"default-dockercfg-b5ptc\"" Jun 12 17:59:50.149174 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.149152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x"] Jun 12 17:59:50.184891 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.184854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-proc\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.184891 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.184890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq256\" (UniqueName: \"kubernetes.io/projected/d1a040ee-91db-44e4-b738-23d59a3c8270-kube-api-access-rq256\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.185160 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.184911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-podres\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.185160 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.184972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-sys\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.185160 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.185066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-lib-modules\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286279 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-sys\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-lib-modules\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286357 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-sys\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-proc\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286473 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq256\" (UniqueName: \"kubernetes.io/projected/d1a040ee-91db-44e4-b738-23d59a3c8270-kube-api-access-rq256\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286673 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-podres\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286673 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-lib-modules\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286673 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-proc\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.286673 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.286621 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a040ee-91db-44e4-b738-23d59a3c8270-podres\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.295429 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.295395 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq256\" (UniqueName: \"kubernetes.io/projected/d1a040ee-91db-44e4-b738-23d59a3c8270-kube-api-access-rq256\") pod \"perf-node-gather-daemonset-kpf7x\" (UID: \"d1a040ee-91db-44e4-b738-23d59a3c8270\") " pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.449448 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.449419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:50.591879 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:50.591854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x"] Jun 12 17:59:50.593876 ip-10-0-129-69 kubenswrapper[2581]: W0612 17:59:50.593839 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1a040ee_91db_44e4_b738_23d59a3c8270.slice/crio-4e22d187c0ddc8ce770ab8fe50e50b1e08bff318a648736d7a60f55c039f05c6 WatchSource:0}: Error finding container 4e22d187c0ddc8ce770ab8fe50e50b1e08bff318a648736d7a60f55c039f05c6: Status 404 returned error can't find the container with id 4e22d187c0ddc8ce770ab8fe50e50b1e08bff318a648736d7a60f55c039f05c6 Jun 12 17:59:51.203342 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:51.203316 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-7znnb_7fed2d3c-2ab8-4955-a4ce-53f07b096680/volume-data-source-validator/0.log" Jun 12 17:59:51.467899 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:51.467816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" event={"ID":"d1a040ee-91db-44e4-b738-23d59a3c8270","Type":"ContainerStarted","Data":"fc82297ef9550eca840df63e6ffb25769ac4b74bd6a4d6ebd14ec788f8829b5a"} Jun 12 17:59:51.467899 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:51.467875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" event={"ID":"d1a040ee-91db-44e4-b738-23d59a3c8270","Type":"ContainerStarted","Data":"4e22d187c0ddc8ce770ab8fe50e50b1e08bff318a648736d7a60f55c039f05c6"} Jun 12 17:59:51.468144 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:51.467916 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:51.487612 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:51.487565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" podStartSLOduration=1.487549997 podStartE2EDuration="1.487549997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 17:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 17:59:51.484318713 +0000 UTC m=+1340.521504407" watchObservedRunningTime="2026-06-12 17:59:51.487549997 +0000 UTC m=+1340.524735689" Jun 12 17:59:52.411429 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:52.411400 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lnsw_bc17e1f7-bd48-4bc6-af52-5318f946462f/dns/0.log" Jun 12 17:59:52.432860 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:52.432832 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lnsw_bc17e1f7-bd48-4bc6-af52-5318f946462f/kube-rbac-proxy/0.log" Jun 12 17:59:52.562429 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:52.562396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h9lw_2c891c1c-fcf1-418f-a049-46bef8baec37/dns-node-resolver/0.log" Jun 12 17:59:53.165804 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:53.165770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-789b5cf674-vrlsg_6154f5d4-b81f-401e-bc0b-a3f7278bdf1e/registry/0.log" Jun 12 17:59:53.169899 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:53.169877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-789b5cf674-vrlsg_6154f5d4-b81f-401e-bc0b-a3f7278bdf1e/registry/1.log" Jun 12 17:59:53.240452 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:53.240420 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrfdv_f5f2d5bf-ca7b-486a-89ab-abfebf500d5b/node-ca/0.log" Jun 12 17:59:54.290009 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:54.289978 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-blnwv_837bd67f-9310-431a-83dd-9afb244573f0/discovery/0.log" Jun 12 17:59:54.310251 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:54.310226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5b76d6b9-2p8sd_ae2ca501-777f-4c37-ae32-95ed942cec8b/kube-auth-proxy/0.log" Jun 12 17:59:54.390670 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:54.390644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2vp5h_328a7a60-8b82-4147-b0ef-703617a21901/payload-pre-processing/0.log" Jun 12 17:59:54.414086 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:54.414061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-qrtw7_2fe63091-17ae-4900-9d45-2c1b910ed44c/payload-processing/0.log" Jun 12 17:59:54.439336 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:54.439314 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6cc649d-9zh9g_a348a5e7-8064-4361-8ef7-3a70f88dd904/router/0.log" Jun 12 17:59:55.137488 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:55.137461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kl9ks_ad6f19ac-a96f-4c8e-8f6c-41bbcee072c5/serve-healthcheck-canary/0.log" Jun 12 17:59:55.726285 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:55.726258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-gvfz7_5afeed3b-81c5-4f66-a92d-6dc43db97e5b/insights-operator/0.log" Jun 12 17:59:55.727121 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:55.727102 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-gvfz7_5afeed3b-81c5-4f66-a92d-6dc43db97e5b/insights-operator/1.log" Jun 12 17:59:55.992609 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:55.992533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z2tsl_ca459b33-6832-4f9a-8260-d8ede9cfe55f/kube-rbac-proxy/0.log" Jun 12 17:59:56.030276 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:56.030247 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z2tsl_ca459b33-6832-4f9a-8260-d8ede9cfe55f/exporter/0.log" Jun 12 17:59:56.067793 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:56.067757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z2tsl_ca459b33-6832-4f9a-8260-d8ede9cfe55f/extractor/0.log" Jun 12 17:59:57.483016 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:57.482990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6zwfp/perf-node-gather-daemonset-kpf7x" Jun 12 17:59:58.425406 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.425379 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c4d8df475-w8c8w_ddc5097b-ea77-4e98-b48d-1d0a82e50738/nginx/0.log" Jun 12 17:59:58.454622 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.454593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-62rm9_7dbfaa4c-35fb-41e6-9dba-51fd51b017e8/manager/0.log" Jun 12 17:59:58.488824 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.488801 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9ndnn_c1e4e9e1-62a9-4768-9c5b-ea4f8bfecef1/manager/0.log" Jun 12 17:59:58.577374 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.577349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ps96w_e02ae075-302b-4d1e-a440-997da22760f1/server/0.log" Jun 12 17:59:58.715993 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.715911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cd4b5f47-ld9dd_da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73/manager/0.log" Jun 12 17:59:58.738741 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.738717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cd4b5f47-ld9dd_da5ec992-ac6a-4cbd-89fa-f88cf5b3bf73/copy-manifests/0.log" Jun 12 17:59:58.825525 ip-10-0-129-69 kubenswrapper[2581]: I0612 17:59:58.825496 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7qwn4_913e65bd-7d50-4055-95a9-ff787c009792/postgres/0.log" Jun 12 18:00:00.143548 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.143511 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688120-2vw2p"] Jun 12 18:00:00.147345 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.147324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" Jun 12 18:00:00.149833 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.149811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vgk8j\"" Jun 12 18:00:00.154468 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.154440 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688120-2vw2p"] Jun 12 18:00:00.159506 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.159475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mngd\" (UniqueName: \"kubernetes.io/projected/378aec83-b06b-45d9-b96e-749c12a821d2-kube-api-access-8mngd\") pod \"maas-api-key-cleanup-29688120-2vw2p\" (UID: \"378aec83-b06b-45d9-b96e-749c12a821d2\") " pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" Jun 12 18:00:00.260053 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.260016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mngd\" (UniqueName: \"kubernetes.io/projected/378aec83-b06b-45d9-b96e-749c12a821d2-kube-api-access-8mngd\") pod \"maas-api-key-cleanup-29688120-2vw2p\" (UID: \"378aec83-b06b-45d9-b96e-749c12a821d2\") " pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" Jun 12 18:00:00.268306 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.268275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mngd\" (UniqueName: \"kubernetes.io/projected/378aec83-b06b-45d9-b96e-749c12a821d2-kube-api-access-8mngd\") pod \"maas-api-key-cleanup-29688120-2vw2p\" (UID: \"378aec83-b06b-45d9-b96e-749c12a821d2\") " pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" Jun 12 18:00:00.459655 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.459623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" Jun 12 18:00:00.593036 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.593006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688120-2vw2p"] Jun 12 18:00:00.594887 ip-10-0-129-69 kubenswrapper[2581]: W0612 18:00:00.594856 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378aec83_b06b_45d9_b96e_749c12a821d2.slice/crio-4a9d755dd036af05909196a4f47383f8d5d80c8a9e5d52f5502c40e5ac2e405b WatchSource:0}: Error finding container 4a9d755dd036af05909196a4f47383f8d5d80c8a9e5d52f5502c40e5ac2e405b: Status 404 returned error can't find the container with id 4a9d755dd036af05909196a4f47383f8d5d80c8a9e5d52f5502c40e5ac2e405b Jun 12 18:00:00.596798 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:00.596783 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:00:01.517425 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:01.517390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688120-2vw2p" event={"ID":"378aec83-b06b-45d9-b96e-749c12a821d2","Type":"ContainerStarted","Data":"4a9d755dd036af05909196a4f47383f8d5d80c8a9e5d52f5502c40e5ac2e405b"} Jun 12 18:00:05.168506 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:05.168473 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-blnwv_837bd67f-9310-431a-83dd-9afb244573f0/discovery/0.log" Jun 12 18:00:05.178264 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:05.178218 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5b76d6b9-2p8sd_ae2ca501-777f-4c37-ae32-95ed942cec8b/kube-auth-proxy/0.log" Jun 12 18:00:05.226213 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:05.226167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2vp5h_328a7a60-8b82-4147-b0ef-703617a21901/payload-pre-processing/0.log" Jun 12 18:00:05.242817 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:05.242789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-qrtw7_2fe63091-17ae-4900-9d45-2c1b910ed44c/payload-processing/0.log" Jun 12 18:00:05.260880 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:05.260842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6cc649d-9zh9g_a348a5e7-8064-4361-8ef7-3a70f88dd904/router/0.log" Jun 12 18:00:06.483073 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:06.482946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-blnwv_837bd67f-9310-431a-83dd-9afb244573f0/discovery/0.log" Jun 12 18:00:06.494624 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:06.494597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5b76d6b9-2p8sd_ae2ca501-777f-4c37-ae32-95ed942cec8b/kube-auth-proxy/0.log" Jun 12 18:00:06.549094 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:06.549040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2vp5h_328a7a60-8b82-4147-b0ef-703617a21901/payload-pre-processing/0.log" Jun 12 18:00:06.569382 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:06.569340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-qrtw7_2fe63091-17ae-4900-9d45-2c1b910ed44c/payload-processing/0.log" Jun 12 18:00:06.591422 ip-10-0-129-69 kubenswrapper[2581]: I0612 18:00:06.591393 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6cc649d-9zh9g_a348a5e7-8064-4361-8ef7-3a70f88dd904/router/0.log"