Jun 10 00:21:31.805715 ip-10-0-130-91 systemd[1]: Starting Kubernetes Kubelet... Jun 10 00:21:32.283491 ip-10-0-130-91 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:21:32.283491 ip-10-0-130-91 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 00:21:32.283491 ip-10-0-130-91 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:21:32.283491 ip-10-0-130-91 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 00:21:32.283491 ip-10-0-130-91 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:21:32.284142 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.283534 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 00:21:32.290250 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290226 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.290250 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290249 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290254 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290273 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290279 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290283 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290288 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290292 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290296 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290299 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290302 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290306 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290309 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290312 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290314 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290317 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290320 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290322 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290325 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290328 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290331 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.290340 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290333 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290336 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290340 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290344 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290347 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290351 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290353 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290356 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290359 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290362 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290364 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290367 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290370 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290372 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290375 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290378 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290381 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290384 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290387 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290390 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.290817 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290392 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290395 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290397 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290400 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290403 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290405 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290408 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290411 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290413 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290416 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290419 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290421 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290424 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290427 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290429 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290432 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290435 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290437 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290440 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290443 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.291328 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290446 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290450 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290452 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290455 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290458 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290461 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290464 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290467 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290469 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290472 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290475 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290477 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290480 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290482 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290488 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290491 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290494 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290497 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290500 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290504 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.291828 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290507 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290510 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290513 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290516 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290519 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290522 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290525 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290528 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290530 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290533 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290535 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290538 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290541 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290543 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290546 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290549 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290552 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.290554 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291306 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.292324 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291312 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291315 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291318 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291321 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291325 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291327 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291330 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291333 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291336 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291339 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291341 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291344 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291347 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291350 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291353 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291356 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291358 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291361 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291364 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291368 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.292783 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291371 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291373 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291376 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291379 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291381 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291384 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291387 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291389 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291393 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291395 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291398 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291401 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291403 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291406 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291408 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291411 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291414 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291416 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291419 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291422 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.293380 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291424 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291427 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291429 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291432 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291434 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291437 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291440 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291443 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291445 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291449 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291453 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291456 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291459 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291461 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291476 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291480 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291482 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291485 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291488 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291491 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.293877 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291494 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291504 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291507 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291510 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291513 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291516 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291518 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291521 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291524 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291527 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291530 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291533 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291536 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291539 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291542 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291544 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291548 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291551 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291553 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.294393 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291556 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291561 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291564 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291567 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291570 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291572 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291575 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291578 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291580 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291583 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291586 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291588 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291591 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291594 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291596 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291602 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291605 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291609 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.291612 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.294860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292025 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292031 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292035 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292038 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292041 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292044 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292046 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292049 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292052 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292055 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292057 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292060 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292063 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292065 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292068 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292070 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292073 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292075 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292079 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.295343 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292083 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292086 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292089 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292092 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292094 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292097 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292100 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292102 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292106 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292109 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292112 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292115 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292118 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292126 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292129 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292132 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292134 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292137 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292140 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.295860 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292142 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292145 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292149 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292152 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292155 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292159 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292162 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292164 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292167 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292170 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292172 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292175 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292177 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292180 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292182 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292185 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292187 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292190 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292192 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.296353 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292195 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292197 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292203 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292206 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292209 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292212 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292214 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292220 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292223 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292226 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292228 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292231 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292233 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292236 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292238 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292241 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292243 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292246 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292249 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292251 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.296824 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292253 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292271 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292275 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292279 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292283 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292286 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292289 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292292 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292294 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292297 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292300 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292303 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292306 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292309 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292313 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292316 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292318 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292323 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292326 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292330 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.297364 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292333 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.292335 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292410 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292417 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292424 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292429 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292434 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292437 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292441 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292450 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292454 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292457 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292460 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292464 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292467 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292470 2560 flags.go:64] FLAG: --cgroup-root="" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292473 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292477 2560 flags.go:64] FLAG: --client-ca-file="" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292480 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292483 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292488 2560 flags.go:64] FLAG: --cluster-domain="" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292491 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292494 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292497 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 00:21:32.297861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292501 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292505 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292510 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292513 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292516 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292519 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292523 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292528 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292531 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292534 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292539 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292542 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292545 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292548 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292551 2560 flags.go:64] FLAG: --enable-server="true" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292554 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292558 2560 flags.go:64] FLAG: --event-burst="100" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292562 2560 flags.go:64] FLAG: --event-qps="50" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292565 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292568 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292571 2560 flags.go:64] FLAG: --eviction-hard="" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292575 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292578 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292581 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292584 2560 flags.go:64] FLAG: --eviction-soft="" Jun 10 00:21:32.298485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292587 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292590 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292593 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292596 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292599 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292602 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292605 2560 flags.go:64] FLAG: --feature-gates="" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292608 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292612 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292616 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292619 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292623 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292626 2560 flags.go:64] FLAG: --help="false" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292629 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292634 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292637 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292640 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292643 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292647 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292650 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292653 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292656 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292659 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 00:21:32.299154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292662 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292665 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292669 2560 flags.go:64] FLAG: --kube-reserved="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292672 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292674 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292678 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292681 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292684 2560 flags.go:64] FLAG: --lock-file="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292687 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292690 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292693 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292699 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292702 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292705 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292708 2560 flags.go:64] FLAG: --logging-format="text" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292711 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292714 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292717 2560 flags.go:64] FLAG: --manifest-url="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292721 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292725 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292729 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292733 2560 flags.go:64] FLAG: --max-pods="110" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292736 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292741 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292744 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 00:21:32.299899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292747 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292750 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292753 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292757 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292764 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292768 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292771 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292774 2560 flags.go:64] FLAG: --pod-cidr="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292777 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292783 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292786 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292789 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292792 2560 flags.go:64] FLAG: --port="10250" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292796 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292799 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d71a7b3e294b9a2" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292802 2560 flags.go:64] FLAG: --qos-reserved="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292805 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292808 2560 flags.go:64] FLAG: --register-node="true" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292811 2560 flags.go:64] FLAG: --register-with-taints="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292815 2560 flags.go:64] FLAG: --registry-burst="10" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292818 2560 flags.go:64] FLAG: --registry-qps="5" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292821 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292824 2560 flags.go:64] FLAG: --reserved-memory="" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292828 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292831 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 00:21:32.300638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292835 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292838 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292841 2560 flags.go:64] FLAG: --runonce="false" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292844 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292847 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292851 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292854 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292857 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292860 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292863 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292866 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292869 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292872 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292875 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292878 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292881 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292884 2560 flags.go:64] FLAG: --system-cgroups="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292886 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292892 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292895 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292897 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292902 2560 flags.go:64] FLAG: --tls-min-version="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292905 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292908 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292910 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 00:21:32.301478 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292914 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292917 2560 flags.go:64] FLAG: --v="2" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292921 2560 flags.go:64] FLAG: --version="false" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292925 2560 flags.go:64] FLAG: --vmodule="" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292929 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.292933 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293064 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293068 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293071 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293074 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293077 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293080 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293083 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293085 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293088 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293091 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293094 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293096 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293099 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293102 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293104 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.302368 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293107 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293109 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293114 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293118 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293121 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293124 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293127 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293130 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293133 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293136 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293138 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293141 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293144 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293146 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293149 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293152 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293155 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293157 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293160 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293163 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.302900 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293165 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293168 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293170 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293173 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293176 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293178 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293181 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293185 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293187 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293190 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293192 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293195 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293197 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293200 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293202 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293205 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293207 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293210 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293212 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.303421 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293215 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293217 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293220 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293222 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293226 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293229 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293232 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293234 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293237 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293239 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293242 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293245 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293248 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293250 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293253 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293270 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293273 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293277 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293281 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.303896 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293284 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293288 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293291 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293294 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293297 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293300 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293303 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293305 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293308 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293311 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293313 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293316 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293318 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293321 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293325 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293328 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293330 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293333 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293336 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293338 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.304377 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293341 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293344 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293346 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293349 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293351 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.293356 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.293362 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.302177 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.302420 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.302444 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.302454 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302531 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302537 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302541 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302544 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.304870 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302547 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302551 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302554 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302557 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302559 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302562 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302564 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302567 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302570 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302573 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302576 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302578 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302581 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302583 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302586 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302589 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302591 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302594 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302597 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302599 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.305247 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302602 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302605 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302607 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302610 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302613 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302617 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302620 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302624 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302628 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302632 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302634 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302637 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302640 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302643 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302645 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302648 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302650 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302653 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302656 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.305749 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302659 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302661 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302664 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302667 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302669 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302672 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302675 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302677 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302680 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302683 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302685 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302688 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302690 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302693 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302696 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302698 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302701 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302704 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302708 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302711 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.306253 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302714 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302716 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302719 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302722 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302724 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302727 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302730 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302732 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302735 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302738 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302740 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302743 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302745 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302748 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302751 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302753 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302756 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302758 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302761 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302763 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.306767 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302766 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302769 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302772 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302775 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302780 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302783 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302787 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302789 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302792 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302795 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302799 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302803 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302807 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302810 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302813 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.307270 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302815 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.302820 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302942 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302948 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302950 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302954 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302956 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302959 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302963 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302967 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302970 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302973 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302976 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302980 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:21:32.307658 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302985 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302988 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302991 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302994 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.302997 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303000 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303002 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303005 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303008 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303011 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303014 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303017 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303020 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303023 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303025 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303028 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303031 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303033 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303036 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303038 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:21:32.307999 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303041 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303044 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303046 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303049 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303051 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303054 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303056 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303059 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303062 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303065 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303067 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303070 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303073 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303076 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303079 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303082 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303084 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303087 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303090 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303092 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:21:32.308505 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303095 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303097 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303100 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303103 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303106 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303108 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303111 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303113 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303116 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303118 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303121 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303124 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303126 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303129 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303132 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303134 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303137 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303140 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303143 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303146 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:21:32.308996 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303148 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303151 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303154 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303156 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303159 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303163 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303167 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303169 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303172 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303174 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303177 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303180 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303182 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303185 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303187 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303190 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303193 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303196 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303199 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:21:32.309524 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303201 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303204 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303206 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303209 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303211 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303214 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303216 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:32.303219 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.303224 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.303366 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.306027 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.307666 2560 server.go:1019] "Starting client certificate rotation" Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.307768 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:21:32.309991 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.307802 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:21:32.310497 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.310045 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:21:32.311307 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.311290 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:21:32.321895 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.321874 2560 log.go:25] "Validated CRI v1 runtime API" Jun 10 00:21:32.325273 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.325216 2560 log.go:25] "Validated CRI v1 image API" Jun 10 00:21:32.326095 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.326078 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 00:21:32.328346 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.328326 2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b0ba0e68-9727-4b12-8f24-0ec3ac3dd1d0:/dev/nvme0n1p3 c5cf8d6f-5441-4729-927e-e1910b066479:/dev/nvme0n1p4] Jun 10 00:21:32.328399 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.328345 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 00:21:32.332076 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.332059 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:21:32.334083 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.333965 2560 manager.go:216] Machine: {Timestamp:2026-06-10 00:21:32.332780692 +0000 UTC m=+0.379324564 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100273 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e51e5864cc0a7cad29199b27b1e1 SystemUUID:ec26e51e-5864-cc0a-7cad-29199b27b1e1 BootID:a78bd99b-5fe0-4e00-958f-3210d76572d1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:24:0b:39:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:24:0b:39:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:25:0d:7a:32:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 00:21:32.334083 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.334081 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 00:21:32.334203 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.334171 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 00:21:32.337428 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.337398 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 00:21:32.337577 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.337430 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 00:21:32.338596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.338585 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 00:21:32.338637 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.338599 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 00:21:32.338637 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.338606 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:21:32.339364 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.339353 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:21:32.340963 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.340952 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 00:21:32.343964 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.343951 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:21:32.344094 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344085 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 00:21:32.344127 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344114 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 10 00:21:32.344158 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344136 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 00:21:32.344158 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344148 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 00:21:32.344212 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344165 2560 kubelet.go:398] "Adding apiserver pod source" Jun 10 00:21:32.344212 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344179 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 00:21:32.344745 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344716 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:21:32.344888 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.344745 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:21:32.347680 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.347637 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 00:21:32.349353 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.349340 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 00:21:32.349400 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.349370 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 00:21:32.350775 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350763 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350779 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350785 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350791 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350800 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350807 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350818 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 00:21:32.350825 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350824 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 00:21:32.351003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350831 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 00:21:32.351003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350837 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 00:21:32.351003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350845 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 00:21:32.351003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.350850 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 00:21:32.351606 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.351596 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 00:21:32.351606 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.351606 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 00:21:32.354766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.354741 2560 server.go:1268] "Started kubelet" Jun 10 00:21:32.354880 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.354805 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 00:21:32.354935 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.354839 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 00:21:32.355040 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.354959 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 00:21:32.355614 ip-10-0-130-91 systemd[1]: Started Kubernetes Kubelet. Jun 10 00:21:32.357000 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.356974 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 00:21:32.357100 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.357018 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 00:21:32.357100 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.357051 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 10 00:21:32.357100 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.357066 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 00:21:32.359799 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.359781 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 00:21:32.362902 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.362880 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 00:21:32.363122 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.362146 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18b79059a5b20a0e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-06-10 00:21:32.354718222 +0000 UTC m=+0.401262076,LastTimestamp:2026-06-10 00:21:32.354718222 +0000 UTC m=+0.401262076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}" Jun 10 00:21:32.365223 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.365201 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 00:21:32.365318 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.365209 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 00:21:32.365636 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.365615 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.366101 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366083 2560 factory.go:55] Registering systemd factory Jun 10 00:21:32.366187 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366106 2560 factory.go:223] Registration of the systemd container factory successfully Jun 10 00:21:32.366282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366213 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 00:21:32.366282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366214 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 00:21:32.366282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366251 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 00:21:32.366432 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366378 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 10 00:21:32.366432 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366391 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 10 00:21:32.366830 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366814 2560 factory.go:153] Registering CRI-O factory Jun 10 00:21:32.366830 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366829 2560 factory.go:223] Registration of the crio container factory successfully Jun 10 00:21:32.366936 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366871 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 00:21:32.366936 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366889 2560 factory.go:103] Registering Raw factory Jun 10 00:21:32.366936 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.366900 2560 manager.go:1196] Started watching for new ooms in manager Jun 10 00:21:32.367332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.367310 2560 manager.go:349] Starting recovery of all containers Jun 10 00:21:32.370087 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.370056 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 00:21:32.370219 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.370196 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 00:21:32.377857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.377828 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkm9g" Jun 10 00:21:32.378142 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.378122 2560 manager.go:354] Recovery completed Jun 10 00:21:32.380462 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.380432 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 00:21:32.383390 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.383376 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.384837 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.384823 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkm9g" Jun 10 00:21:32.385219 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385205 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.385278 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385232 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.385278 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385243 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.385796 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385782 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 00:21:32.385796 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385794 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 00:21:32.385889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385822 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.385889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.385858 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:21:32.386554 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.386535 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.386613 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.386567 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.386613 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.386580 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.387018 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.387005 2560 policy_none.go:49] "None policy: Start" Jun 10 00:21:32.387076 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.387022 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 00:21:32.387076 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.387033 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 00:21:32.387173 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.387028 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18b79059a783758f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-06-10 00:21:32.385219983 +0000 UTC m=+0.431763837,LastTimestamp:2026-06-10 00:21:32.385219983 +0000 UTC m=+0.431763837,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}" Jun 10 00:21:32.388058 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.388046 2560 policy_none.go:47] "Start" Jun 10 00:21:32.430947 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.430930 2560 manager.go:337] "Starting Device Plugin manager" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.430970 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.430984 2560 server.go:87] "Starting device plugin registration server" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.431286 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.431300 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.431401 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.431540 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.431546 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.432255 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.432324 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.437893 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.439287 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.439325 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.439348 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.439385 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 00:21:32.445567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.441321 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:32.531751 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.531714 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.532862 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.532844 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.532924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.532876 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.532924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.532891 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.532924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.532915 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.539934 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.539885 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"] Jun 10 00:21:32.539981 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.539957 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.540773 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.540757 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.540855 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.540786 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.540855 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.540796 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.542107 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542074 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.542107 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.542095 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-91.ec2.internal\": node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.542305 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542232 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.542364 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.542364 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542361 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.542916 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542900 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.542981 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542923 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.542981 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542931 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.543081 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.542984 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.543081 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.543011 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.543081 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.543026 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.544122 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.544108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.544177 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.544139 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:21:32.544837 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.544819 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:21:32.544912 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.544854 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:21:32.544912 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.544870 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:21:32.561867 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.561846 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.ec2.internal\" not found" node="ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.563082 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.563063 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.565295 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.565278 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.ec2.internal\" not found" node="ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.664062 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.664021 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.668385 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.668362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.668493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.668396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54af077af9c0dd29d16ee84c02a23950-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"54af077af9c0dd29d16ee84c02a23950\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.668493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.668420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.764519 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.764476 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.768835 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54af077af9c0dd29d16ee84c02a23950-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"54af077af9c0dd29d16ee84c02a23950\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.768882 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.768882 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.768986 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768892 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.768986 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54af077af9c0dd29d16ee84c02a23950-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"54af077af9c0dd29d16ee84c02a23950\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.768986 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.768924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f502c3910c535eca9f03debc4d7bca8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"0f502c3910c535eca9f03debc4d7bca8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.865308 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.865216 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:32.866330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.866316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.870031 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:32.869793 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:32.965894 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:32.965850 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:33.066308 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.066271 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:33.166754 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.166675 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found" Jun 10 00:21:33.199254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.199227 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:33.266162 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.266128 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" Jun 10 00:21:33.278252 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.278227 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:21:33.279773 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.279758 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" Jun 10 00:21:33.287731 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.287708 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:21:33.306872 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.306851 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 00:21:33.307020 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.307003 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:21:33.307080 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.307033 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:21:33.326362 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.326334 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:33.345306 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.345277 2560 apiserver.go:52] "Watching apiserver" Jun 10 00:21:33.355279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.355242 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 00:21:33.355606 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.355587 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-r29zq","openshift-dns/node-resolver-wd98q","openshift-network-operator/iptables-alerter-vk64g","openshift-ovn-kubernetes/ovnkube-node-jbqmc","kube-system/konnectivity-agent-924kb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd","openshift-image-registry/node-ca-j874n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal","openshift-multus/multus-additional-cni-plugins-jcths","openshift-multus/multus-sjn5c","openshift-multus/network-metrics-daemon-pm8pj","openshift-network-diagnostics/network-check-target-5tpxs","kube-system/global-pull-secret-syncer-8n52q","kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"] Jun 10 00:21:33.358306 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.358284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.359798 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.359775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.359889 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.359849 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:33.360560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.360537 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xmtsj\"" Jun 10 00:21:33.360701 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.360684 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.360766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.360752 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.360766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.360761 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 00:21:33.361206 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.361193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.362594 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.362578 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.363314 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.363296 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxz4s\"" Jun 10 00:21:33.363575 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.363555 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.363648 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.363573 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.363648 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.363561 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 00:21:33.364163 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.364142 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.364515 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.364499 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 00:21:33.364877 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.364860 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 00:21:33.365457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365443 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 00:21:33.365509 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.365996 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365976 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.365996 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365985 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.366121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365980 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 00:21:33.366121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.366010 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 00:21:33.366121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.365979 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8kps\"" Jun 10 00:21:33.366596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.366582 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 00:21:33.366671 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.366603 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 00:21:33.366671 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.366633 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvnvb\"" Jun 10 00:21:33.367045 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.367031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.367561 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.367538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 00:21:33.367636 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.367623 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.367698 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.367623 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v65qk\"" Jun 10 00:21:33.367698 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.367652 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.368350 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.368322 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.369405 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369125 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.369405 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369238 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 00:21:33.369561 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369506 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.369754 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369711 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 00:21:33.369958 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369914 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nl74c\"" Jun 10 00:21:33.370033 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.369955 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 00:21:33.370317 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.370297 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.370448 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.370431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jc2ff\"" Jun 10 00:21:33.370550 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.370524 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.371745 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.371627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.371883 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.371852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2rj\" (UniqueName: \"kubernetes.io/projected/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kube-api-access-gx2rj\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.371966 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.371894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mq7l\" (UniqueName: \"kubernetes.io/projected/eedb0f84-97e8-4031-8c77-b201cf836238-kube-api-access-7mq7l\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.371966 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.371945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-kubelet\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.371975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-node-log\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-script-lib\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.372053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eedb0f84-97e8-4031-8c77-b201cf836238-host-slash\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.372200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.372200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-ovn\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-config\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-env-overrides\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovn-node-metrics-cert\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfzzt\" (UniqueName: \"kubernetes.io/projected/898fd31e-6c77-43ef-84b4-3cac036e245f-kube-api-access-xfzzt\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eedb0f84-97e8-4031-8c77-b201cf836238-iptables-alerter-script\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-etc-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372392 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-os-release\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372407 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd05a87e-1be8-4bf7-8473-682fc3207ce7-host\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4sfr\" (UniqueName: \"kubernetes.io/projected/cd05a87e-1be8-4bf7-8473-682fc3207ce7-kube-api-access-f4sfr\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-kubelet-config\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htf29\" (UniqueName: \"kubernetes.io/projected/2afacfef-234d-4bde-ae5c-92ca1de036eb-kube-api-access-htf29\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-device-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-system-cni-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-dbus\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd05a87e-1be8-4bf7-8473-682fc3207ce7-serviceca\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-slash\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.372712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-socket-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-sys-fs\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b3a1239-2c31-46ba-8882-96405a4e2209-agent-certs\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b3a1239-2c31-46ba-8882-96405a4e2209-konnectivity-ca\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-systemd-units\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-netns\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-var-lib-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-netd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-cnibin\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-systemd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.372987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-log-socket\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-bin\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.373053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-registration-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.373726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373232 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.373779 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373740 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 00:21:33.373779 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373743 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 00:21:33.373779 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.373743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sbgfz\"" Jun 10 00:21:33.374473 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.374458 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.374530 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.374514 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:33.375285 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.375252 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdccc\"" Jun 10 00:21:33.375361 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.375290 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 00:21:33.376599 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.376426 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:33.376599 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.376513 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:33.379397 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.379379 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:21:33.387011 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.386959 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:16:32 +0000 UTC" deadline="2028-02-13 07:00:55.052620363 +0000 UTC" Jun 10 00:21:33.387092 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.387011 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14718h39m21.665612857s" Jun 10 00:21:33.398080 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.398058 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzqkg" Jun 10 00:21:33.405611 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.405383 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f502c3910c535eca9f03debc4d7bca8.slice/crio-6d3a1c9109b85f45a242cfe058e01ce2da3b32a5b206724259f2dbf2080068fc WatchSource:0}: Error finding container 6d3a1c9109b85f45a242cfe058e01ce2da3b32a5b206724259f2dbf2080068fc: Status 404 returned error can't find the container with id 6d3a1c9109b85f45a242cfe058e01ce2da3b32a5b206724259f2dbf2080068fc Jun 10 00:21:33.405866 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.405847 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54af077af9c0dd29d16ee84c02a23950.slice/crio-1ab637b539a6e132bf6dc7e4c7192ffb26ee2e6edbe3f19951a1e1d541a9c9a7 WatchSource:0}: Error finding container 1ab637b539a6e132bf6dc7e4c7192ffb26ee2e6edbe3f19951a1e1d541a9c9a7: Status 404 returned error can't find the container with id 1ab637b539a6e132bf6dc7e4c7192ffb26ee2e6edbe3f19951a1e1d541a9c9a7 Jun 10 00:21:33.409362 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.409341 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzqkg" Jun 10 00:21:33.410146 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.410126 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:21:33.443163 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.443116 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" event={"ID":"54af077af9c0dd29d16ee84c02a23950","Type":"ContainerStarted","Data":"1ab637b539a6e132bf6dc7e4c7192ffb26ee2e6edbe3f19951a1e1d541a9c9a7"} Jun 10 00:21:33.444295 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.444251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"0f502c3910c535eca9f03debc4d7bca8","Type":"ContainerStarted","Data":"6d3a1c9109b85f45a242cfe058e01ce2da3b32a5b206724259f2dbf2080068fc"} Jun 10 00:21:33.455160 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.455142 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:33.467879 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.467859 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 00:21:33.474035 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-socket-dir-parent\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-kubelet\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2js94\" (UniqueName: \"kubernetes.io/projected/96a93ca9-0162-4610-89ee-96b20937fdbf-kube-api-access-2js94\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.474151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-tmp\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-socket-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-k8s-cni-cncf-io\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-netns\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-tuned\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474344 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-socket-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-var-lib-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474372 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-var-lib-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-netd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-daemon-config\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-netd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-modprobe-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-conf\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-var-lib-kubelet\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqj69\" (UniqueName: \"kubernetes.io/projected/83b20108-d6a0-4b4f-9fe1-241ebbf16169-kube-api-access-hqj69\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-bin\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2rj\" (UniqueName: \"kubernetes.io/projected/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kube-api-access-gx2rj\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mq7l\" (UniqueName: \"kubernetes.io/projected/eedb0f84-97e8-4031-8c77-b201cf836238-kube-api-access-7mq7l\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-config\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-env-overrides\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfzzt\" (UniqueName: \"kubernetes.io/projected/898fd31e-6c77-43ef-84b4-3cac036e245f-kube-api-access-xfzzt\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4sfr\" (UniqueName: \"kubernetes.io/projected/cd05a87e-1be8-4bf7-8473-682fc3207ce7-kube-api-access-f4sfr\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-kubelet-config\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-conf-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.474766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-cni-bin\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.474818 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-kubelet-config\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-systemd\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.474923 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:33.974865354 +0000 UTC m=+2.021409200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-etc-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-etc-openvswitch\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.474991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-os-release\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-os-release\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd05a87e-1be8-4bf7-8473-682fc3207ce7-serviceca\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-cnibin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-cni-binary-copy\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-multus\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysconfig\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.475523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-sys\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-lib-modules\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-env-overrides\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-slash\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475360 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-slash\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-sys-fs\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b3a1239-2c31-46ba-8882-96405a4e2209-agent-certs\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-config\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b3a1239-2c31-46ba-8882-96405a4e2209-konnectivity-ca\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-sys-fs\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-system-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-host\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee347e3-515f-4143-a61c-46bcd4f56d22-tmp-dir\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwvw\" (UniqueName: \"kubernetes.io/projected/dee347e3-515f-4143-a61c-46bcd4f56d22-kube-api-access-snwvw\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-systemd-units\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd05a87e-1be8-4bf7-8473-682fc3207ce7-serviceca\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-netns\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475622 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-systemd-units\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-run-netns\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-cnibin\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475705 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-cnibin\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-os-release\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-run\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475743 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-systemd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-log-socket\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-systemd\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-registration-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b3a1239-2c31-46ba-8882-96405a4e2209-konnectivity-ca\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475874 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-log-socket\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.476995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475920 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-registration-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-kubelet\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-node-log\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.475985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-script-lib\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eedb0f84-97e8-4031-8c77-b201cf836238-host-slash\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-etc-kubernetes\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-node-log\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-host-kubelet\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eedb0f84-97e8-4031-8c77-b201cf836238-host-slash\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-ovn\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476141 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2afacfef-234d-4bde-ae5c-92ca1de036eb-run-ovn\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovn-node-metrics-cert\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477519 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eedb0f84-97e8-4031-8c77-b201cf836238-iptables-alerter-script\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-bin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-hostroot\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476378 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd05a87e-1be8-4bf7-8473-682fc3207ce7-host\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-multus-certs\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfxsb\" (UniqueName: \"kubernetes.io/projected/4e537f10-ef8c-4fff-bb10-a051fb172084-kube-api-access-kfxsb\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htf29\" (UniqueName: \"kubernetes.io/projected/2afacfef-234d-4bde-ae5c-92ca1de036eb-kube-api-access-htf29\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-device-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-system-cni-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-dbus\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovnkube-script-lib\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-kubernetes\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dee347e3-515f-4143-a61c-46bcd4f56d22-hosts-file\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476711 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898fd31e-6c77-43ef-84b4-3cac036e245f-system-cni-dir\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.477982 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476747 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/898fd31e-6c77-43ef-84b4-3cac036e245f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.478501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd05a87e-1be8-4bf7-8473-682fc3207ce7-host\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.478501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476760 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-device-dir\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.478501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476866 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eedb0f84-97e8-4031-8c77-b201cf836238-iptables-alerter-script\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.478501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.476886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b24f943-2775-46bf-9466-a6806a10f790-dbus\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.479041 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.479014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2afacfef-234d-4bde-ae5c-92ca1de036eb-ovn-node-metrics-cert\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.479213 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.479184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b3a1239-2c31-46ba-8882-96405a4e2209-agent-certs\") pod \"konnectivity-agent-924kb\" (UID: \"1b3a1239-2c31-46ba-8882-96405a4e2209\") " pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.484526 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.484495 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfzzt\" (UniqueName: \"kubernetes.io/projected/898fd31e-6c77-43ef-84b4-3cac036e245f-kube-api-access-xfzzt\") pod \"multus-additional-cni-plugins-jcths\" (UID: \"898fd31e-6c77-43ef-84b4-3cac036e245f\") " pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.484643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.484617 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4sfr\" (UniqueName: \"kubernetes.io/projected/cd05a87e-1be8-4bf7-8473-682fc3207ce7-kube-api-access-f4sfr\") pod \"node-ca-j874n\" (UID: \"cd05a87e-1be8-4bf7-8473-682fc3207ce7\") " pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.484853 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.484831 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2rj\" (UniqueName: \"kubernetes.io/projected/2871036e-fdd6-46bf-9a53-a4d306c2fa6e-kube-api-access-gx2rj\") pod \"aws-ebs-csi-driver-node-p4ljd\" (UID: \"2871036e-fdd6-46bf-9a53-a4d306c2fa6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.484985 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.484969 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mq7l\" (UniqueName: \"kubernetes.io/projected/eedb0f84-97e8-4031-8c77-b201cf836238-kube-api-access-7mq7l\") pod \"iptables-alerter-vk64g\" (UID: \"eedb0f84-97e8-4031-8c77-b201cf836238\") " pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.485348 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.485334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htf29\" (UniqueName: \"kubernetes.io/projected/2afacfef-234d-4bde-ae5c-92ca1de036eb-kube-api-access-htf29\") pod \"ovnkube-node-jbqmc\" (UID: \"2afacfef-234d-4bde-ae5c-92ca1de036eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.577079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577049 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-conf-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-systemd\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-cnibin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-cni-binary-copy\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-conf-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-systemd\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-cnibin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-multus\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-multus\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysconfig\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-sys\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577392 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.577379 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.577436 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:21:34.077415693 +0000 UTC m=+2.123959545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-lib-modules\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysconfig\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-lib-modules\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-sys\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-system-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-host\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-system-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee347e3-515f-4143-a61c-46bcd4f56d22-tmp-dir\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-host\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snwvw\" (UniqueName: \"kubernetes.io/projected/dee347e3-515f-4143-a61c-46bcd4f56d22-kube-api-access-snwvw\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-os-release\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-run\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-etc-kubernetes\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-bin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.577892 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-os-release\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-cni-binary-copy\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577779 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-run\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-etc-kubernetes\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577797 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-cni-bin\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-hostroot\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577852 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dee347e3-515f-4143-a61c-46bcd4f56d22-tmp-dir\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577847 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-hostroot\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-multus-certs\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfxsb\" (UniqueName: \"kubernetes.io/projected/4e537f10-ef8c-4fff-bb10-a051fb172084-kube-api-access-kfxsb\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-cni-dir\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-multus-certs\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-kubernetes\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dee347e3-515f-4143-a61c-46bcd4f56d22-hosts-file\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-socket-dir-parent\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-kubelet\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.578658 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.577994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2js94\" (UniqueName: \"kubernetes.io/projected/96a93ca9-0162-4610-89ee-96b20937fdbf-kube-api-access-2js94\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-kubernetes\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-tmp\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578039 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-var-lib-kubelet\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-k8s-cni-cncf-io\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578061 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-socket-dir-parent\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dee347e3-515f-4143-a61c-46bcd4f56d22-hosts-file\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-netns\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-tuned\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578119 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-netns\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e537f10-ef8c-4fff-bb10-a051fb172084-host-run-k8s-cni-cncf-io\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-daemon-config\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-modprobe-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-conf\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-var-lib-kubelet\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqj69\" (UniqueName: \"kubernetes.io/projected/83b20108-d6a0-4b4f-9fe1-241ebbf16169-kube-api-access-hqj69\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578332 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-modprobe-d\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578353 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-sysctl-conf\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83b20108-d6a0-4b4f-9fe1-241ebbf16169-var-lib-kubelet\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.579716 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.578696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e537f10-ef8c-4fff-bb10-a051fb172084-multus-daemon-config\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.580182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.580165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-tmp\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.580224 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.580198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83b20108-d6a0-4b4f-9fe1-241ebbf16169-etc-tuned\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.586313 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.586285 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:33.586313 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.586308 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:33.586503 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.586333 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:33.586503 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.586415 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:21:34.086395224 +0000 UTC m=+2.132939082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:33.588358 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.588326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfxsb\" (UniqueName: \"kubernetes.io/projected/4e537f10-ef8c-4fff-bb10-a051fb172084-kube-api-access-kfxsb\") pod \"multus-sjn5c\" (UID: \"4e537f10-ef8c-4fff-bb10-a051fb172084\") " pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.588358 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.588340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwvw\" (UniqueName: \"kubernetes.io/projected/dee347e3-515f-4143-a61c-46bcd4f56d22-kube-api-access-snwvw\") pod \"node-resolver-wd98q\" (UID: \"dee347e3-515f-4143-a61c-46bcd4f56d22\") " pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.588482 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.588460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2js94\" (UniqueName: \"kubernetes.io/projected/96a93ca9-0162-4610-89ee-96b20937fdbf-kube-api-access-2js94\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:33.588482 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.588471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqj69\" (UniqueName: \"kubernetes.io/projected/83b20108-d6a0-4b4f-9fe1-241ebbf16169-kube-api-access-hqj69\") pod \"tuned-r29zq\" (UID: \"83b20108-d6a0-4b4f-9fe1-241ebbf16169\") " pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.685555 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.685478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j874n" Jun 10 00:21:33.694052 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.694011 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd05a87e_1be8_4bf7_8473_682fc3207ce7.slice/crio-15b7109541d75e45ca5bf19828cd9c32ae079e4f16559ba06ee1c542410c0363 WatchSource:0}: Error finding container 15b7109541d75e45ca5bf19828cd9c32ae079e4f16559ba06ee1c542410c0363: Status 404 returned error can't find the container with id 15b7109541d75e45ca5bf19828cd9c32ae079e4f16559ba06ee1c542410c0363 Jun 10 00:21:33.713858 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.713832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vk64g" Jun 10 00:21:33.720824 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.720802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:33.721063 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.721041 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedb0f84_97e8_4031_8c77_b201cf836238.slice/crio-e302978851e8679bf3273b2c61b64b7e29f189854a5dc7b356f3e171e676847b WatchSource:0}: Error finding container e302978851e8679bf3273b2c61b64b7e29f189854a5dc7b356f3e171e676847b: Status 404 returned error can't find the container with id e302978851e8679bf3273b2c61b64b7e29f189854a5dc7b356f3e171e676847b Jun 10 00:21:33.725189 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.725173 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:33.730195 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.730097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" Jun 10 00:21:33.734607 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.734404 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3a1239_2c31_46ba_8882_96405a4e2209.slice/crio-849afb612ac63fd577c06ce43b384bfe275445be2f68fac431b7ee3fd59b3fd6 WatchSource:0}: Error finding container 849afb612ac63fd577c06ce43b384bfe275445be2f68fac431b7ee3fd59b3fd6: Status 404 returned error can't find the container with id 849afb612ac63fd577c06ce43b384bfe275445be2f68fac431b7ee3fd59b3fd6 Jun 10 00:21:33.735929 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.735906 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jcths" Jun 10 00:21:33.740845 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.740822 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2871036e_fdd6_46bf_9a53_a4d306c2fa6e.slice/crio-489e3125b7db08e611069fcc1f8a9637c55747b4691a3f957052f5ffeb9ed62b WatchSource:0}: Error finding container 489e3125b7db08e611069fcc1f8a9637c55747b4691a3f957052f5ffeb9ed62b: Status 404 returned error can't find the container with id 489e3125b7db08e611069fcc1f8a9637c55747b4691a3f957052f5ffeb9ed62b Jun 10 00:21:33.741534 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.741516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r29zq" Jun 10 00:21:33.743779 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.743758 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898fd31e_6c77_43ef_84b4_3cac036e245f.slice/crio-938ade737bdebdba0568a0eaebe8ae2ac51c0b850357f7edbd9540198b6801b9 WatchSource:0}: Error finding container 938ade737bdebdba0568a0eaebe8ae2ac51c0b850357f7edbd9540198b6801b9: Status 404 returned error can't find the container with id 938ade737bdebdba0568a0eaebe8ae2ac51c0b850357f7edbd9540198b6801b9 Jun 10 00:21:33.747421 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.747390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wd98q" Jun 10 00:21:33.749333 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.749305 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b20108_d6a0_4b4f_9fe1_241ebbf16169.slice/crio-4848cf12f195db29d0d82e5bb97ea333161d6770e2fe3ccff200e5332a0e9c6d WatchSource:0}: Error finding container 4848cf12f195db29d0d82e5bb97ea333161d6770e2fe3ccff200e5332a0e9c6d: Status 404 returned error can't find the container with id 4848cf12f195db29d0d82e5bb97ea333161d6770e2fe3ccff200e5332a0e9c6d Jun 10 00:21:33.751775 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.751756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjn5c" Jun 10 00:21:33.755002 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.754983 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee347e3_515f_4143_a61c_46bcd4f56d22.slice/crio-c89d73ead79bbdd780d848a4bdda60ee085ebed922ea278917f51bb9cc6aece6 WatchSource:0}: Error finding container c89d73ead79bbdd780d848a4bdda60ee085ebed922ea278917f51bb9cc6aece6: Status 404 returned error can't find the container with id c89d73ead79bbdd780d848a4bdda60ee085ebed922ea278917f51bb9cc6aece6 Jun 10 00:21:33.759596 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:21:33.759568 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e537f10_ef8c_4fff_bb10_a051fb172084.slice/crio-e055a0e7cb7237d30349491904a06657ad51b2c5730cb914b4bc29915ee3273d WatchSource:0}: Error finding container e055a0e7cb7237d30349491904a06657ad51b2c5730cb914b4bc29915ee3273d: Status 404 returned error can't find the container with id e055a0e7cb7237d30349491904a06657ad51b2c5730cb914b4bc29915ee3273d Jun 10 00:21:33.981116 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:33.981022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:33.981244 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.981157 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:33.981244 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:33.981220 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:34.981200945 +0000 UTC m=+3.027744807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:34.082322 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.081493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:34.082322 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.081751 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:34.082322 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.081839 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:21:35.081808478 +0000 UTC m=+3.128352324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:34.182569 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.182529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:34.182812 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.182727 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:34.182812 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.182748 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:34.182812 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.182761 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:34.182969 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.182819 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:21:35.182802138 +0000 UTC m=+3.229345982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:34.342091 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.341810 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:34.412094 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.412026 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:16:33 +0000 UTC" deadline="2028-01-06 07:47:11.7495289 +0000 UTC" Jun 10 00:21:34.412094 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.412092 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13807h25m37.337441576s" Jun 10 00:21:34.478424 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.478386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjn5c" event={"ID":"4e537f10-ef8c-4fff-bb10-a051fb172084","Type":"ContainerStarted","Data":"e055a0e7cb7237d30349491904a06657ad51b2c5730cb914b4bc29915ee3273d"} Jun 10 00:21:34.509288 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.509231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wd98q" event={"ID":"dee347e3-515f-4143-a61c-46bcd4f56d22","Type":"ContainerStarted","Data":"c89d73ead79bbdd780d848a4bdda60ee085ebed922ea278917f51bb9cc6aece6"} Jun 10 00:21:34.526241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.526197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r29zq" event={"ID":"83b20108-d6a0-4b4f-9fe1-241ebbf16169","Type":"ContainerStarted","Data":"4848cf12f195db29d0d82e5bb97ea333161d6770e2fe3ccff200e5332a0e9c6d"} Jun 10 00:21:34.550595 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.550554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerStarted","Data":"938ade737bdebdba0568a0eaebe8ae2ac51c0b850357f7edbd9540198b6801b9"} Jun 10 00:21:34.553622 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.553585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" event={"ID":"2871036e-fdd6-46bf-9a53-a4d306c2fa6e","Type":"ContainerStarted","Data":"489e3125b7db08e611069fcc1f8a9637c55747b4691a3f957052f5ffeb9ed62b"} Jun 10 00:21:34.558741 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.558707 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-924kb" event={"ID":"1b3a1239-2c31-46ba-8882-96405a4e2209","Type":"ContainerStarted","Data":"849afb612ac63fd577c06ce43b384bfe275445be2f68fac431b7ee3fd59b3fd6"} Jun 10 00:21:34.564714 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.564603 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"f53c53b0068dab5839838a4fb3ca910adc838c4eb3bea751e7b01e30c55cd213"} Jun 10 00:21:34.573981 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.573890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vk64g" event={"ID":"eedb0f84-97e8-4031-8c77-b201cf836238","Type":"ContainerStarted","Data":"e302978851e8679bf3273b2c61b64b7e29f189854a5dc7b356f3e171e676847b"} Jun 10 00:21:34.589031 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.588991 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j874n" event={"ID":"cd05a87e-1be8-4bf7-8473-682fc3207ce7","Type":"ContainerStarted","Data":"15b7109541d75e45ca5bf19828cd9c32ae079e4f16559ba06ee1c542410c0363"} Jun 10 00:21:34.989952 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:34.989889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:34.990102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.990061 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:34.990159 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:34.990125 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:36.990105475 +0000 UTC m=+5.036649321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:35.090665 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.090628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:35.090855 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.090809 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:35.090898 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.090876 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:21:37.09085712 +0000 UTC m=+5.137400968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:35.194592 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.193867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:35.194592 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.194067 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:35.194592 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.194090 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:35.194592 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.194132 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:35.194592 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.194191 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:21:37.194172101 +0000 UTC m=+5.240715954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:35.413149 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.413058 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:16:33 +0000 UTC" deadline="2028-01-04 11:30:25.181438856 +0000 UTC" Jun 10 00:21:35.413149 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.413099 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13763h8m49.768345212s" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.439575 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.439706 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.439797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.439878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.439933 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:35.441622 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:35.439994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:35.871789 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:35.871480 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:21:37.015686 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.015653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:37.016155 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.015834 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:37.016155 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.015897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:41.015878093 +0000 UTC m=+9.062421938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:37.116851 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.116759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:37.117038 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.116959 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:37.117098 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.117055 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:21:41.11702286 +0000 UTC m=+9.163566703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:37.217700 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.217200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:37.217700 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.217379 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:37.217700 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.217398 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:37.217700 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.217418 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:37.217700 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.217480 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:21:41.217461329 +0000 UTC m=+9.264005175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:37.440529 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.440447 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:37.440529 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.440486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:37.440529 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:37.440486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:37.440798 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.440555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:37.440798 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.440694 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:37.440908 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:37.440799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:39.440322 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:39.440471 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:39.440912 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:39.441016 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:39.441077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:39.441183 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:39.441143 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:41.048337 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.048280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:41.048798 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.048461 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:41.048798 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.048547 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:49.04852468 +0000 UTC m=+17.095068528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:41.148942 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.148901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:41.149120 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.149058 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:41.149187 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.149126 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:21:49.149110829 +0000 UTC m=+17.195654673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:41.249909 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.249866 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:41.250117 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.250043 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:41.250117 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.250072 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:41.250117 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.250087 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:41.250293 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.250140 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:21:49.2501252 +0000 UTC m=+17.296669054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.440230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.440251 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.440374 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:41.440406 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.440504 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:41.440764 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:41.440596 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:43.439591 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:43.439555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:43.440056 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:43.439572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:43.440056 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:43.439692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:43.440056 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:43.439683 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:43.440056 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:43.439787 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:43.440056 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:43.439932 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:45.439786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.439728 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:45.439786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.439759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:45.439786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.439763 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:45.440434 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:45.439879 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:45.440434 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:45.439964 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:45.440434 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:45.440041 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:45.643596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.643360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" event={"ID":"54af077af9c0dd29d16ee84c02a23950","Type":"ContainerStarted","Data":"b66c5d25c0d11a07eb3c6d2d291ca4f212381f4916d8900fb2350943aca238d9"} Jun 10 00:21:45.645508 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.645470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r29zq" event={"ID":"83b20108-d6a0-4b4f-9fe1-241ebbf16169","Type":"ContainerStarted","Data":"6bc23a565cf88d64d3d53a5e27f1956925ca55247b30db900b46026cab3dbab8"} Jun 10 00:21:45.658956 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.658907 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" podStartSLOduration=12.658892965 podStartE2EDuration="12.658892965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:45.658524323 +0000 UTC m=+13.705068204" watchObservedRunningTime="2026-06-10 00:21:45.658892965 +0000 UTC m=+13.705436902" Jun 10 00:21:45.672832 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:45.672786 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r29zq" podStartSLOduration=2.618652938 podStartE2EDuration="13.672770492s" totalImagesPullingTime="11.054117554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:45.672349443 +0000 UTC m=+13.718893306" watchObservedRunningTime="2026-06-10 00:21:45.672770492 +0000 UTC m=+13.719314352" Jun 10 00:21:46.649422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.649332 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"0f502c3910c535eca9f03debc4d7bca8","Type":"ContainerStarted","Data":"1377e2c451fade9b466d4c2402a8e1766b37f5703c2a4102ac51ad298c7fcee2"} Jun 10 00:21:46.651162 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.651119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wd98q" event={"ID":"dee347e3-515f-4143-a61c-46bcd4f56d22","Type":"ContainerStarted","Data":"2452adf630ae35c7506e700a550312f2bb7031abf71639465063a2784221bdcc"} Jun 10 00:21:46.652836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.652802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerStarted","Data":"e57288dc055d7849012347ae7d8e8b492328e119c1706fead0bf74cfd0661bde"} Jun 10 00:21:46.654369 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.654345 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" event={"ID":"2871036e-fdd6-46bf-9a53-a4d306c2fa6e","Type":"ContainerStarted","Data":"13ea3db38aeb32d3744711c389aec747de283ac8a15fbbe64837fef49d894141"} Jun 10 00:21:46.655848 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.655826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-924kb" event={"ID":"1b3a1239-2c31-46ba-8882-96405a4e2209","Type":"ContainerStarted","Data":"4bc4b900773aa6ed564f242a5334089468bc3a5ff30c7093c1d9b34d1cedf558"} Jun 10 00:21:46.657557 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.657526 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vk64g" event={"ID":"eedb0f84-97e8-4031-8c77-b201cf836238","Type":"ContainerStarted","Data":"b130aef417dbe0505c18db15a49e6217d1b4047edcb5b5be2686c886da9ac22a"} Jun 10 00:21:46.659091 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.659068 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j874n" event={"ID":"cd05a87e-1be8-4bf7-8473-682fc3207ce7","Type":"ContainerStarted","Data":"8975dfceb8c79497f0012dc84a9e859d4f6164efacf0afb6025f560590efcc82"} Jun 10 00:21:46.676162 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.676101 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vk64g" podStartSLOduration=3.609264745 podStartE2EDuration="14.676085553s" totalImagesPullingTime="11.066820808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:46.675648274 +0000 UTC m=+14.722192138" watchObservedRunningTime="2026-06-10 00:21:46.676085553 +0000 UTC m=+14.722629417" Jun 10 00:21:46.708015 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.707956 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wd98q" podStartSLOduration=3.700993565 podStartE2EDuration="14.707936288s" totalImagesPullingTime="11.006942723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:46.707905539 +0000 UTC m=+14.754449426" watchObservedRunningTime="2026-06-10 00:21:46.707936288 +0000 UTC m=+14.754480154" Jun 10 00:21:46.721140 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.721077 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j874n" podStartSLOduration=3.627925088 podStartE2EDuration="14.721057823s" totalImagesPullingTime="11.093132735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:46.720516462 +0000 UTC m=+14.767060327" watchObservedRunningTime="2026-06-10 00:21:46.721057823 +0000 UTC m=+14.767601686" Jun 10 00:21:46.734303 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:46.734230 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-924kb" podStartSLOduration=3.682331264 podStartE2EDuration="14.734211616s" totalImagesPullingTime="11.051880352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:46.733718855 +0000 UTC m=+14.780262718" watchObservedRunningTime="2026-06-10 00:21:46.734211616 +0000 UTC m=+14.780755481" Jun 10 00:21:47.440523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:47.440489 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:47.440711 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:47.440528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:47.440711 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:47.440536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:47.440711 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:47.440629 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:47.440878 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:47.440731 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:47.440878 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:47.440812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:49.109319 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.109278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:49.110123 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.109422 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:49.110123 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.109487 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:05.10946831 +0000 UTC m=+33.156012165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:21:49.210155 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.210108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:49.210421 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.210287 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:49.210421 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.210368 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:22:05.210350487 +0000 UTC m=+33.256894329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:21:49.311385 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.311338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:49.311551 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.311515 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:21:49.311551 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.311539 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:21:49.311551 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.311549 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:49.311648 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.311613 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:22:05.311588469 +0000 UTC m=+33.358132310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:21:49.439680 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.439584 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:49.439680 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.439631 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:49.439680 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.439631 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:49.439930 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.439728 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:49.439930 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.439835 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:49.439930 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:49.439906 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:49.667935 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.667885 2560 generic.go:356] "Generic (PLEG): container finished" podID="0f502c3910c535eca9f03debc4d7bca8" containerID="1377e2c451fade9b466d4c2402a8e1766b37f5703c2a4102ac51ad298c7fcee2" exitCode=0 Jun 10 00:21:49.668125 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.667953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"0f502c3910c535eca9f03debc4d7bca8","Type":"ContainerDied","Data":"1377e2c451fade9b466d4c2402a8e1766b37f5703c2a4102ac51ad298c7fcee2"} Jun 10 00:21:49.671430 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.670316 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="e57288dc055d7849012347ae7d8e8b492328e119c1706fead0bf74cfd0661bde" exitCode=0 Jun 10 00:21:49.671430 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:49.670367 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"e57288dc055d7849012347ae7d8e8b492328e119c1706fead0bf74cfd0661bde"} Jun 10 00:21:50.290897 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:50.290683 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:50.291471 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:50.291443 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:51.439970 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:51.439934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:51.439970 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:51.439973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:51.440485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:51.439973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:51.440485 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:51.440055 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:51.440485 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:51.440150 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:51.440485 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:51.440238 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:53.439966 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:53.439875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:53.440421 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:53.439875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:53.440421 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:53.440008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:53.440421 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:53.439883 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:53.440421 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:53.440095 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:53.440421 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:53.440179 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:54.520915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.520883 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 00:21:54.682822 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.682567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" event={"ID":"2871036e-fdd6-46bf-9a53-a4d306c2fa6e","Type":"ContainerStarted","Data":"186a9f6cf15f8f02ce40773d75ef59831bf8c48ad60de5e3252fce6432bba776"} Jun 10 00:21:54.684723 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.684698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:21:54.685198 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.685171 2560 generic.go:356] "Generic (PLEG): container finished" podID="2afacfef-234d-4bde-ae5c-92ca1de036eb" containerID="c8fb73f99f0d91d2ffc554106ef1a9e43b16ae2ed0ebe9ce77d61499a7a6deec" exitCode=1 Jun 10 00:21:54.685297 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.685275 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"917e94fe1cd88442a85f26ad59445d1b3915118affefcc4bc2872a4c9dac8c70"} Jun 10 00:21:54.685384 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.685363 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerDied","Data":"c8fb73f99f0d91d2ffc554106ef1a9e43b16ae2ed0ebe9ce77d61499a7a6deec"} Jun 10 00:21:54.685469 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.685427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"fc118f6db9889c7a36b11f76290414ae18b0054a59e22918600b406875930688"} Jun 10 00:21:54.687972 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.687946 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"0f502c3910c535eca9f03debc4d7bca8","Type":"ContainerStarted","Data":"df84e6816026540309e09999fc9e639b111a4f4ba19773b256e6ec0781646679"} Jun 10 00:21:54.689511 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.689488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjn5c" event={"ID":"4e537f10-ef8c-4fff-bb10-a051fb172084","Type":"ContainerStarted","Data":"213bfb445b932dd6556b25d1fba0e87b5454b36ffa6dcdeb04f45de56fe16af1"} Jun 10 00:21:54.715800 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.715739 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sjn5c" podStartSLOduration=2.153284752 podStartE2EDuration="22.715715162s" totalImagesPullingTime="20.56243041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:54.715508543 +0000 UTC m=+22.762052407" watchObservedRunningTime="2026-06-10 00:21:54.715715162 +0000 UTC m=+22.762259027" Jun 10 00:21:54.716804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:54.716761 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" podStartSLOduration=21.716748301 podStartE2EDuration="21.716748301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:54.700655946 +0000 UTC m=+22.747199809" watchObservedRunningTime="2026-06-10 00:21:54.716748301 +0000 UTC m=+22.763292165" Jun 10 00:21:55.440286 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.440244 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:55.440472 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.440293 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:55.440472 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.440346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:55.440472 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:55.440359 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:55.440472 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:55.440419 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:55.440608 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:55.440472 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:55.442406 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.442287 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T00:21:54.520909032Z","UUID":"fbe37711-7a48-45c0-953e-abc546632eb3","Handler":null,"Name":"","Endpoint":""} Jun 10 00:21:55.443908 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.443891 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 00:21:55.444011 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.443922 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 00:21:55.695318 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.695237 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:21:55.696059 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.695851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"a0fd8c5dc87a4446c7bc08c57e8efe3b82d809bdd65f614661b52bc0d1b5f2f7"} Jun 10 00:21:55.696059 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.695973 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"a216301ed1697ca8895d57434c67b32a9691138a7783b762dac3bb1cd1d29b28"} Jun 10 00:21:55.696059 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:55.696025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"a297c4055134dcff216be98b69455b9bb0832b9bd011e9e6f19821c9f029df8b"} Jun 10 00:21:56.702554 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:56.702517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" event={"ID":"2871036e-fdd6-46bf-9a53-a4d306c2fa6e","Type":"ContainerStarted","Data":"cf82c5c1016dac38efe3476fb020868cd04854e332f77c9634bb32727c5145ac"} Jun 10 00:21:56.718417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:56.718359 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4ljd" podStartSLOduration=4.308380541 podStartE2EDuration="24.718337988s" totalImagesPullingTime="20.409957447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.717972194 +0000 UTC m=+24.764516058" watchObservedRunningTime="2026-06-10 00:21:56.718337988 +0000 UTC m=+24.764881853" Jun 10 00:21:57.439754 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:57.439668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:57.439754 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:57.439709 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:57.439754 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:57.439716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:57.439976 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:57.439795 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:57.439976 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:57.439876 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:57.439976 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:57.439932 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:57.709012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:57.708935 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:21:57.709451 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:57.709362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"d6f1b7396949e3b7016699165118e7f5fe2ad09f4e2e115c5242b9a5668aba94"} Jun 10 00:21:59.439974 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.439769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:21:59.440385 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.439805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:21:59.440385 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:59.440065 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:21:59.440385 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.439814 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:21:59.440385 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:59.440169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:21:59.440385 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:21:59.440326 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:21:59.718524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.718421 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:21:59.718873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.718846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"fa9245c6641dfcf52c69b779dcab2e54648bbe927438e3069782e9e1e65b59e7"} Jun 10 00:21:59.719253 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.719224 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:59.719389 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.719329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:59.719389 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.719382 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:59.719494 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.719455 2560 scope.go:117] "RemoveContainer" containerID="c8fb73f99f0d91d2ffc554106ef1a9e43b16ae2ed0ebe9ce77d61499a7a6deec" Jun 10 00:21:59.724746 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.724676 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:59.724868 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.724817 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 00:21:59.725285 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.725248 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-924kb" Jun 10 00:21:59.737027 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.737001 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:21:59.737171 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:21:59.737142 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:22:01.335228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.335126 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8n52q"] Jun 10 00:22:01.335649 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.335368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:01.335649 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:01.335495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:22:01.338119 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.338089 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5tpxs"] Jun 10 00:22:01.338270 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.338214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:01.338357 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:01.338337 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:22:01.338789 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.338727 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pm8pj"] Jun 10 00:22:01.338906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.338846 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:01.338972 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:01.338953 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:22:01.725564 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.725485 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="4ab3ffe6b367f52cc105700dac817828ba51d178258ea6dbc8ec610f0dc17865" exitCode=0 Jun 10 00:22:01.725701 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.725557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"4ab3ffe6b367f52cc105700dac817828ba51d178258ea6dbc8ec610f0dc17865"} Jun 10 00:22:01.729414 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.729304 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:22:01.729645 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.729625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" event={"ID":"2afacfef-234d-4bde-ae5c-92ca1de036eb","Type":"ContainerStarted","Data":"2f1e49da122d8a9e0096134cf72a1fb5df4946b2907390fa6c62e23920470f4b"} Jun 10 00:22:01.770218 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:01.770163 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" podStartSLOduration=9.176346773 podStartE2EDuration="29.770146696s" totalImagesPullingTime="20.593799923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:01.768933527 +0000 UTC m=+29.815477390" watchObservedRunningTime="2026-06-10 00:22:01.770146696 +0000 UTC m=+29.816690558" Jun 10 00:22:02.474808 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:02.474774 2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898fd31e_6c77_43ef_84b4_3cac036e245f.slice/crio-c0c1290b18a53cc43d65f3efa6e31f9717b8deac423f9f3edfcf1322f897ad18.scope\": RecentStats: unable to find data in memory cache]" Jun 10 00:22:02.734545 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:02.734450 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="c0c1290b18a53cc43d65f3efa6e31f9717b8deac423f9f3edfcf1322f897ad18" exitCode=0 Jun 10 00:22:02.734545 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:02.734530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"c0c1290b18a53cc43d65f3efa6e31f9717b8deac423f9f3edfcf1322f897ad18"} Jun 10 00:22:03.440524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:03.440490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:03.440692 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:03.440490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:03.440692 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:03.440596 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:22:03.440761 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:03.440697 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:22:03.440761 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:03.440490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:03.440817 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:03.440774 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:22:03.741086 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:03.741004 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="d80ef598bc3e0d914706768c8769167b95b04ed74d582e9db29a6f30343fd43c" exitCode=0 Jun 10 00:22:03.741560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:03.741077 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"d80ef598bc3e0d914706768c8769167b95b04ed74d582e9db29a6f30343fd43c"} Jun 10 00:22:05.124350 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.124306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:05.124966 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.124485 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:22:05.124966 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.124554 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret podName:9b24f943-2775-46bf-9466-a6806a10f790 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:37.124535233 +0000 UTC m=+65.171079074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret") pod "global-pull-secret-syncer-8n52q" (UID: "9b24f943-2775-46bf-9466-a6806a10f790") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:22:05.225350 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.225294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:05.225538 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.225469 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:22:05.225595 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.225548 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:22:37.225527457 +0000 UTC m=+65.272071301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:22:05.326469 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.326427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:05.326641 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.326598 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:22:05.326641 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.326622 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:22:05.326641 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.326632 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fwd85 for pod openshift-network-diagnostics/network-check-target-5tpxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:22:05.326752 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.326689 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85 podName:03559b57-3d68-4d6e-93c3-cdd3a1b031ae nodeName:}" failed. No retries permitted until 2026-06-10 00:22:37.326672641 +0000 UTC m=+65.373216482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwd85" (UniqueName: "kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85") pod "network-check-target-5tpxs" (UID: "03559b57-3d68-4d6e-93c3-cdd3a1b031ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:22:05.440537 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.440448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:05.440537 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.440492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:05.440537 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:05.440492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:05.440795 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.440587 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:22:05.440795 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.440693 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:22:05.440795 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:05.440781 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:22:07.439836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:07.439799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:07.440411 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:07.439799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:07.440411 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:07.439928 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:22:07.440411 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:07.440026 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8n52q" podUID="9b24f943-2775-46bf-9466-a6806a10f790" Jun 10 00:22:07.440411 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:07.439799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:07.440411 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:07.440115 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5tpxs" podUID="03559b57-3d68-4d6e-93c3-cdd3a1b031ae" Jun 10 00:22:08.229916 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.229817 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeReady" Jun 10 00:22:08.230089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.229972 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 00:22:08.261999 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.261965 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:22:08.283832 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.283802 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:22:08.283832 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.283838 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9gfx5"] Jun 10 00:22:08.284023 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.283934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.286370 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.286347 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 00:22:08.286370 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.286354 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 00:22:08.286569 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.286408 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 00:22:08.286569 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.286363 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5ppl\"" Jun 10 00:22:08.291482 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.291459 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 00:22:08.304663 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.304637 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kl2vz"] Jun 10 00:22:08.304818 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.304762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.307092 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.307069 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 00:22:08.307092 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.307091 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vpwdb\"" Jun 10 00:22:08.307247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.307070 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 00:22:08.326731 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.326703 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9gfx5"] Jun 10 00:22:08.326888 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.326754 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kl2vz"] Jun 10 00:22:08.326888 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.326841 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.329249 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.329218 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 00:22:08.329249 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.329228 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 00:22:08.329443 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.329285 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 00:22:08.329443 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.329319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8775\"" Jun 10 00:22:08.450808 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64j4t\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.450808 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c017017-a832-4419-bb15-ccb04cbf1b1e-config-volume\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450928 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-cert\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.450975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c017017-a832-4419-bb15-ccb04cbf1b1e-tmp-dir\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llc86\" (UniqueName: \"kubernetes.io/projected/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-kube-api-access-llc86\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.451654 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.451254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njvfp\" (UniqueName: \"kubernetes.io/projected/0c017017-a832-4419-bb15-ccb04cbf1b1e-kube-api-access-njvfp\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.552196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-cert\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.552196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552230 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:08.552361 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:08.552427 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:09.052405528 +0000 UTC m=+37.098949383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c017017-a832-4419-bb15-ccb04cbf1b1e-tmp-dir\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.552493 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llc86\" (UniqueName: \"kubernetes.io/projected/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-kube-api-access-llc86\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njvfp\" (UniqueName: \"kubernetes.io/projected/0c017017-a832-4419-bb15-ccb04cbf1b1e-kube-api-access-njvfp\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64j4t\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c017017-a832-4419-bb15-ccb04cbf1b1e-config-volume\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.552804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.552749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c017017-a832-4419-bb15-ccb04cbf1b1e-tmp-dir\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.553318 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:08.553022 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:08.553318 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:08.553038 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:08.553318 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:08.553093 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:09.053077343 +0000 UTC m=+37.099621199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:08.553318 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.553302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c017017-a832-4419-bb15-ccb04cbf1b1e-config-volume\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.553865 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.553832 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.554189 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.554163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.557306 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.557239 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.557306 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.557283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.557468 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.557338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-cert\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.567137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.567109 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.567137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.567136 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njvfp\" (UniqueName: \"kubernetes.io/projected/0c017017-a832-4419-bb15-ccb04cbf1b1e-kube-api-access-njvfp\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:08.567417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.567396 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64j4t\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:08.567554 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.567534 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llc86\" (UniqueName: \"kubernetes.io/projected/51d97a1a-b9c0-4d9c-a462-aca1e9abda84-kube-api-access-llc86\") pod \"ingress-canary-kl2vz\" (UID: \"51d97a1a-b9c0-4d9c-a462-aca1e9abda84\") " pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:08.636781 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:08.636741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kl2vz" Jun 10 00:22:09.057340 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.057305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:09.057535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.057373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:09.057535 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:09.057473 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:09.057535 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:09.057488 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:09.057664 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:09.057551 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:10.057532293 +0000 UTC m=+38.104076146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:09.057664 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:09.057553 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:09.057664 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:09.057609 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:10.057591676 +0000 UTC m=+38.104135532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:09.440617 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.440533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:09.440769 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.440533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:09.440889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.440533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:09.443401 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.443381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:22:09.444274 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.444241 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:22:09.444377 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.444323 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:22:09.444445 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.444395 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn48h\"" Jun 10 00:22:09.444445 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.444412 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8r5c2\"" Jun 10 00:22:09.444445 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:09.444438 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:22:10.067489 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.067452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.067578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:10.067618 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:10.067704 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:10.067719 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:10.067721 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:12.067698668 +0000 UTC m=+40.114242529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:10.067826 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:10.067820 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:12.067802285 +0000 UTC m=+40.114346130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:10.138619 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.138589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kl2vz"] Jun 10 00:22:10.143153 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:22:10.143129 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d97a1a_b9c0_4d9c_a462_aca1e9abda84.slice/crio-6af9b2d26c1ed425e44a97e3d7ee861ae7153e171ea4eeb310c79a6b542dfbc0 WatchSource:0}: Error finding container 6af9b2d26c1ed425e44a97e3d7ee861ae7153e171ea4eeb310c79a6b542dfbc0: Status 404 returned error can't find the container with id 6af9b2d26c1ed425e44a97e3d7ee861ae7153e171ea4eeb310c79a6b542dfbc0 Jun 10 00:22:10.762251 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.762218 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="f9d428797e84ec0281ecc0d51e2fad3105c07bed31dd9714512ce767ffac5d29" exitCode=0 Jun 10 00:22:10.762464 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.762300 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"f9d428797e84ec0281ecc0d51e2fad3105c07bed31dd9714512ce767ffac5d29"} Jun 10 00:22:10.763564 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:10.763542 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kl2vz" event={"ID":"51d97a1a-b9c0-4d9c-a462-aca1e9abda84","Type":"ContainerStarted","Data":"6af9b2d26c1ed425e44a97e3d7ee861ae7153e171ea4eeb310c79a6b542dfbc0"} Jun 10 00:22:11.768706 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:11.768673 2560 generic.go:356] "Generic (PLEG): container finished" podID="898fd31e-6c77-43ef-84b4-3cac036e245f" containerID="e2ed1b8644a056fbf243cbbf902d33060206bede1a3adbe66ef612b18f6aa464" exitCode=0 Jun 10 00:22:11.769073 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:11.768735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerDied","Data":"e2ed1b8644a056fbf243cbbf902d33060206bede1a3adbe66ef612b18f6aa464"} Jun 10 00:22:12.085513 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.085478 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:12.085678 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.085558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:12.085678 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:12.085631 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:12.085678 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:12.085662 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:12.085678 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:12.085674 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:12.085801 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:12.085695 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:16.085679721 +0000 UTC m=+44.132223565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:12.085801 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:12.085715 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:16.085703663 +0000 UTC m=+44.132247504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:12.776406 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.776318 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jcths" event={"ID":"898fd31e-6c77-43ef-84b4-3cac036e245f","Type":"ContainerStarted","Data":"40f3685c29b810de123f1063fc1bbd1386b9cba496190233b1bec82f28cb3196"} Jun 10 00:22:12.777663 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.777642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kl2vz" event={"ID":"51d97a1a-b9c0-4d9c-a462-aca1e9abda84","Type":"ContainerStarted","Data":"045589caa75af850cc48f6351c9db7f4b65993b1f743740a6267411ac05424f1"} Jun 10 00:22:12.798212 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.798142 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jcths" podStartSLOduration=10.541302431 podStartE2EDuration="40.798124599s" totalImagesPullingTime="30.256822168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:12.796459798 +0000 UTC m=+40.843003662" watchObservedRunningTime="2026-06-10 00:22:12.798124599 +0000 UTC m=+40.844668463" Jun 10 00:22:12.810470 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:12.810418 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kl2vz" podStartSLOduration=2.737876735 podStartE2EDuration="4.810397742s" totalImagesPullingTime="2.072521007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:12.809720233 +0000 UTC m=+40.856264097" watchObservedRunningTime="2026-06-10 00:22:12.810397742 +0000 UTC m=+40.856941606" Jun 10 00:22:16.117942 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:16.117895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:16.117953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:16.118040 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:16.118058 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:16.118080 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:16.118099 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:24.118085694 +0000 UTC m=+52.164629555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:16.118464 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:16.118137 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:24.118118855 +0000 UTC m=+52.164662697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:24.177302 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:24.177241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:24.177332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:24.177409 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:24.177431 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:24.177433 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:24.177501 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:22:40.177481787 +0000 UTC m=+68.224025643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:24.177884 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:24.177519 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:40.177511561 +0000 UTC m=+68.224055403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:32.754282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:32.754240 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbqmc" Jun 10 00:22:37.175590 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.175528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:37.178707 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.178687 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:22:37.189832 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.189799 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b24f943-2775-46bf-9466-a6806a10f790-original-pull-secret\") pod \"global-pull-secret-syncer-8n52q\" (UID: \"9b24f943-2775-46bf-9466-a6806a10f790\") " pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:37.276731 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.276691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:22:37.279086 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.279066 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:22:37.286900 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:37.286879 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:22:37.286955 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:37.286945 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:23:41.286926902 +0000 UTC m=+129.333470742 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : secret "metrics-daemon-secret" not found Jun 10 00:22:37.367155 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.367105 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8n52q" Jun 10 00:22:37.377318 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.377192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:37.379791 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.379763 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:22:37.389785 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.389763 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:22:37.400983 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.400952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd85\" (UniqueName: \"kubernetes.io/projected/03559b57-3d68-4d6e-93c3-cdd3a1b031ae-kube-api-access-fwd85\") pod \"network-check-target-5tpxs\" (UID: \"03559b57-3d68-4d6e-93c3-cdd3a1b031ae\") " pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:37.490727 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.490697 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8n52q"] Jun 10 00:22:37.493978 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:22:37.493952 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b24f943_2775_46bf_9466_a6806a10f790.slice/crio-71c8334f9cb7388f0478f2d6c18b3c5a45fe3776cff83225884ac51235eca2c9 WatchSource:0}: Error finding container 71c8334f9cb7388f0478f2d6c18b3c5a45fe3776cff83225884ac51235eca2c9: Status 404 returned error can't find the container with id 71c8334f9cb7388f0478f2d6c18b3c5a45fe3776cff83225884ac51235eca2c9 Jun 10 00:22:37.654314 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.654277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn48h\"" Jun 10 00:22:37.662360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.662333 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:37.786168 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.786136 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5tpxs"] Jun 10 00:22:37.789160 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:22:37.789129 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03559b57_3d68_4d6e_93c3_cdd3a1b031ae.slice/crio-e1b53c3a9448a2863f5992f310646dd7d7ca398bd4217ee85637c66c2a60e039 WatchSource:0}: Error finding container e1b53c3a9448a2863f5992f310646dd7d7ca398bd4217ee85637c66c2a60e039: Status 404 returned error can't find the container with id e1b53c3a9448a2863f5992f310646dd7d7ca398bd4217ee85637c66c2a60e039 Jun 10 00:22:37.839753 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.839711 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5tpxs" event={"ID":"03559b57-3d68-4d6e-93c3-cdd3a1b031ae","Type":"ContainerStarted","Data":"e1b53c3a9448a2863f5992f310646dd7d7ca398bd4217ee85637c66c2a60e039"} Jun 10 00:22:37.840725 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:37.840700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8n52q" event={"ID":"9b24f943-2775-46bf-9466-a6806a10f790","Type":"ContainerStarted","Data":"71c8334f9cb7388f0478f2d6c18b3c5a45fe3776cff83225884ac51235eca2c9"} Jun 10 00:22:40.199718 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:40.199678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:40.199769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:40.199847 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:40.199866 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:40.199878 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:40.199920 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:23:12.199901847 +0000 UTC m=+100.246445708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:22:40.200102 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:22:40.199935 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:23:12.199930006 +0000 UTC m=+100.246473847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:22:43.857117 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:43.857073 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5tpxs" event={"ID":"03559b57-3d68-4d6e-93c3-cdd3a1b031ae","Type":"ContainerStarted","Data":"3e1313a6fe43c4c41dad2b74635ac5d849871da80f61abc35b949cb5e4caa56e"} Jun 10 00:22:43.857598 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:43.857175 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:22:43.858557 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:43.858534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8n52q" event={"ID":"9b24f943-2775-46bf-9466-a6806a10f790","Type":"ContainerStarted","Data":"e77b14104e22b48eadf908c73971d471627467381cb7c1f6d6b9f022855998d1"} Jun 10 00:22:43.871788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:43.871736 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5tpxs" podStartSLOduration=66.717953438 podStartE2EDuration="1m11.871719503s" totalImagesPullingTime="5.153766065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:43.871013484 +0000 UTC m=+71.917557347" watchObservedRunningTime="2026-06-10 00:22:43.871719503 +0000 UTC m=+71.918263364" Jun 10 00:22:43.887121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:22:43.887071 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8n52q" podStartSLOduration=66.434333255 podStartE2EDuration="1m11.887055245s" totalImagesPullingTime="5.45272199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:43.886317403 +0000 UTC m=+71.932861265" watchObservedRunningTime="2026-06-10 00:22:43.887055245 +0000 UTC m=+71.933599107" Jun 10 00:23:12.218424 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:23:12.218375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:23:12.218446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:12.218529 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:12.218555 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:12.218566 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:12.218610 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:24:16.218593068 +0000 UTC m=+164.265136909 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:23:12.218868 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:12.218625 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:24:16.218618829 +0000 UTC m=+164.265162670 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:23:14.863770 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:23:14.863731 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5tpxs" Jun 10 00:23:41.326182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:23:41.326131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:23:41.326695 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:41.326305 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:23:41.326695 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:23:41.326384 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs podName:96a93ca9-0162-4610-89ee-96b20937fdbf nodeName:}" failed. No retries permitted until 2026-06-10 00:25:43.326367482 +0000 UTC m=+251.372911327 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs") pod "network-metrics-daemon-pm8pj" (UID: "96a93ca9-0162-4610-89ee-96b20937fdbf") : secret "metrics-daemon-secret" not found Jun 10 00:24:11.294597 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:11.294495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" podUID="aef91a83-8228-403a-ad25-c2938857130f" Jun 10 00:24:11.313853 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:11.313810 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9gfx5" podUID="0c017017-a832-4419-bb15-ccb04cbf1b1e" Jun 10 00:24:12.069068 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:12.069038 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:24:12.460524 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:12.460439 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pm8pj" podUID="96a93ca9-0162-4610-89ee-96b20937fdbf" Jun 10 00:24:16.267533 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:16.267475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:24:16.267533 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:16.267544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:24:16.267963 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:16.267627 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:24:16.267963 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:16.267652 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768d88cbc8-qjjd8: secret "image-registry-tls" not found Jun 10 00:24:16.267963 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:16.267637 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:24:16.267963 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:16.267712 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls podName:aef91a83-8228-403a-ad25-c2938857130f nodeName:}" failed. No retries permitted until 2026-06-10 00:26:18.267695829 +0000 UTC m=+286.314239670 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls") pod "image-registry-768d88cbc8-qjjd8" (UID: "aef91a83-8228-403a-ad25-c2938857130f") : secret "image-registry-tls" not found Jun 10 00:24:16.267963 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:16.267725 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls podName:0c017017-a832-4419-bb15-ccb04cbf1b1e nodeName:}" failed. No retries permitted until 2026-06-10 00:26:18.267719786 +0000 UTC m=+286.314263627 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls") pod "dns-default-9gfx5" (UID: "0c017017-a832-4419-bb15-ccb04cbf1b1e") : secret "dns-default-metrics-tls" not found Jun 10 00:24:25.440425 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:25.440376 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:24:26.440140 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:26.440103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:24:32.236690 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.236647 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk"] Jun 10 00:24:32.239585 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.239542 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv"] Jun 10 00:24:32.239737 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.239681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.242169 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.242148 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jvjxj\"" Jun 10 00:24:32.242417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.242373 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.242545 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.242500 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 00:24:32.242545 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.242508 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d"] Jun 10 00:24:32.242669 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.242646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" Jun 10 00:24:32.243085 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.243068 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.245097 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.245080 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8hc24"] Jun 10 00:24:32.245216 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.245149 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.245664 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.245645 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.245770 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.245684 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.245770 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.245724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zj8tm\"" Jun 10 00:24:32.247399 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.247380 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 00:24:32.247915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.247885 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 00:24:32.247995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.247964 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.248254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.248236 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.248392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.248365 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.248453 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.248410 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sflmj\"" Jun 10 00:24:32.251447 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251010 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.251447 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 00:24:32.251447 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251234 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f6vj2\"" Jun 10 00:24:32.251647 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251499 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.251647 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251643 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv"] Jun 10 00:24:32.251745 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.251712 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 00:24:32.252695 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.252675 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk"] Jun 10 00:24:32.256476 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.256455 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 00:24:32.256969 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.256952 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d"] Jun 10 00:24:32.261711 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.261691 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8hc24"] Jun 10 00:24:32.277485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-trusted-ca\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.277597 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/232f4fd7-2bbd-467f-864e-95c9722888c0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.277597 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232f4fd7-2bbd-467f-864e-95c9722888c0-config\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.277597 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gr2\" (UniqueName: \"kubernetes.io/projected/232f4fd7-2bbd-467f-864e-95c9722888c0-kube-api-access-26gr2\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.277697 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg7ph\" (UniqueName: \"kubernetes.io/projected/cb6f56d2-eaca-482d-bdd3-653381c31bb4-kube-api-access-qg7ph\") pod \"volume-data-source-validator-78dd696465-zd6nv\" (UID: \"cb6f56d2-eaca-482d-bdd3-653381c31bb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" Jun 10 00:24:32.277697 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-config\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.277697 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.277786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9fp\" (UniqueName: \"kubernetes.io/projected/1e620195-320c-452a-876a-2b38cc4b27f3-kube-api-access-rh9fp\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.277786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5675b030-ea93-41cc-8c77-4bcc7519d79d-serving-cert\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.277786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.277784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5tz\" (UniqueName: \"kubernetes.io/projected/5675b030-ea93-41cc-8c77-4bcc7519d79d-kube-api-access-8k5tz\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.341513 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.341464 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-ddq87"] Jun 10 00:24:32.345304 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.345276 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l"] Jun 10 00:24:32.345450 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.345417 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.347831 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.347811 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 00:24:32.347928 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.347841 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 00:24:32.348100 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.348078 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.348186 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.348170 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.348247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.348224 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.348356 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.348339 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qlrz4\"" Jun 10 00:24:32.351492 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.351470 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.351604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.351469 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.351604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.351520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f88th\"" Jun 10 00:24:32.351604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.351470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 00:24:32.353121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.353103 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 00:24:32.355920 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.355889 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 00:24:32.356112 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.356093 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ddq87"] Jun 10 00:24:32.357437 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.357415 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l"] Jun 10 00:24:32.378697 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh5tl\" (UniqueName: \"kubernetes.io/projected/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-kube-api-access-jh5tl\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-config\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-snapshots\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-service-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mhc\" (UniqueName: \"kubernetes.io/projected/8502e466-d3ff-4a34-8c54-7f7ccac29760-kube-api-access-l4mhc\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8502e466-d3ff-4a34-8c54-7f7ccac29760-serving-cert\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/232f4fd7-2bbd-467f-864e-95c9722888c0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.378870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378863 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gr2\" (UniqueName: \"kubernetes.io/projected/232f4fd7-2bbd-467f-864e-95c9722888c0-kube-api-access-26gr2\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg7ph\" (UniqueName: \"kubernetes.io/projected/cb6f56d2-eaca-482d-bdd3-653381c31bb4-kube-api-access-qg7ph\") pod \"volume-data-source-validator-78dd696465-zd6nv\" (UID: \"cb6f56d2-eaca-482d-bdd3-653381c31bb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-tmp\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9fp\" (UniqueName: \"kubernetes.io/projected/1e620195-320c-452a-876a-2b38cc4b27f3-kube-api-access-rh9fp\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.378981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5675b030-ea93-41cc-8c77-4bcc7519d79d-serving-cert\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5tz\" (UniqueName: \"kubernetes.io/projected/5675b030-ea93-41cc-8c77-4bcc7519d79d-kube-api-access-8k5tz\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232f4fd7-2bbd-467f-864e-95c9722888c0-config\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-trusted-ca\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.379183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.379171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-trusted-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.381283 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.381249 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 00:24:32.381283 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.381248 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 00:24:32.381426 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.381344 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 00:24:32.381426 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.381255 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 00:24:32.381426 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.381273 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 00:24:32.387795 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.387772 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 00:24:32.389287 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.389253 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:24:32.389416 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.389330 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-config\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.389416 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.389335 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls podName:1e620195-320c-452a-876a-2b38cc4b27f3 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:32.889315201 +0000 UTC m=+180.935859053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2vkk" (UID: "1e620195-320c-452a-876a-2b38cc4b27f3") : secret "samples-operator-tls" not found Jun 10 00:24:32.389655 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.389635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232f4fd7-2bbd-467f-864e-95c9722888c0-config\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.390347 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.390327 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5675b030-ea93-41cc-8c77-4bcc7519d79d-trusted-ca\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.390434 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.390417 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.390748 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.390722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.390847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.390772 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.390847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.390807 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 00:24:32.391417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.391401 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/232f4fd7-2bbd-467f-864e-95c9722888c0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.391605 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.391570 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5675b030-ea93-41cc-8c77-4bcc7519d79d-serving-cert\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.400792 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.400770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.400901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.400820 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.400901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.400770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.400901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.400830 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:32.411396 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.411373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gr2\" (UniqueName: \"kubernetes.io/projected/232f4fd7-2bbd-467f-864e-95c9722888c0-kube-api-access-26gr2\") pod \"service-ca-operator-6bc5ff68f5-5zm2d\" (UID: \"232f4fd7-2bbd-467f-864e-95c9722888c0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.411499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.411374 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9fp\" (UniqueName: \"kubernetes.io/projected/1e620195-320c-452a-876a-2b38cc4b27f3-kube-api-access-rh9fp\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.411599 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.411580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg7ph\" (UniqueName: \"kubernetes.io/projected/cb6f56d2-eaca-482d-bdd3-653381c31bb4-kube-api-access-qg7ph\") pod \"volume-data-source-validator-78dd696465-zd6nv\" (UID: \"cb6f56d2-eaca-482d-bdd3-653381c31bb4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" Jun 10 00:24:32.411635 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.411580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5tz\" (UniqueName: \"kubernetes.io/projected/5675b030-ea93-41cc-8c77-4bcc7519d79d-kube-api-access-8k5tz\") pod \"console-operator-668fdbf85c-8hc24\" (UID: \"5675b030-ea93-41cc-8c77-4bcc7519d79d\") " pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.480289 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-snapshots\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-service-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mhc\" (UniqueName: \"kubernetes.io/projected/8502e466-d3ff-4a34-8c54-7f7ccac29760-kube-api-access-l4mhc\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8502e466-d3ff-4a34-8c54-7f7ccac29760-serving-cert\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-tmp\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480457 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.480699 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.480699 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.480568 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:32.480699 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-trusted-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.480699 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.480623 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:32.980606237 +0000 UTC m=+181.027150078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:32.480699 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh5tl\" (UniqueName: \"kubernetes.io/projected/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-kube-api-access-jh5tl\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.480937 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.480900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-tmp\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.481081 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.481044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-service-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.481191 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.481058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8502e466-d3ff-4a34-8c54-7f7ccac29760-snapshots\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.481233 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.481205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.481646 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.481628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8502e466-d3ff-4a34-8c54-7f7ccac29760-trusted-ca-bundle\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.482848 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.482828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8502e466-d3ff-4a34-8c54-7f7ccac29760-serving-cert\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.490706 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.490647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh5tl\" (UniqueName: \"kubernetes.io/projected/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-kube-api-access-jh5tl\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.491404 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.491386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mhc\" (UniqueName: \"kubernetes.io/projected/8502e466-d3ff-4a34-8c54-7f7ccac29760-kube-api-access-l4mhc\") pod \"insights-operator-896549976-ddq87\" (UID: \"8502e466-d3ff-4a34-8c54-7f7ccac29760\") " pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.560828 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.560796 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zj8tm\"" Jun 10 00:24:32.567848 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.567823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sflmj\"" Jun 10 00:24:32.568817 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.568801 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" Jun 10 00:24:32.572742 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.572722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f6vj2\"" Jun 10 00:24:32.576517 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.576500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" Jun 10 00:24:32.581304 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.581285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:32.657420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.657385 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ddq87" Jun 10 00:24:32.711513 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.711474 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv"] Jun 10 00:24:32.715304 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:32.715270 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6f56d2_eaca_482d_bdd3_653381c31bb4.slice/crio-3cc9ac76925b84117afd46b43517c8d99d98fad60c57d7fd6d56632e6fa0235c WatchSource:0}: Error finding container 3cc9ac76925b84117afd46b43517c8d99d98fad60c57d7fd6d56632e6fa0235c: Status 404 returned error can't find the container with id 3cc9ac76925b84117afd46b43517c8d99d98fad60c57d7fd6d56632e6fa0235c Jun 10 00:24:32.736730 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.736691 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8hc24"] Jun 10 00:24:32.741226 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:32.741170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5675b030_ea93_41cc_8c77_4bcc7519d79d.slice/crio-ca692d2f58589c93cd3cafefc4b4455f5a6ef6fc853a259401b8c4b69735f2aa WatchSource:0}: Error finding container ca692d2f58589c93cd3cafefc4b4455f5a6ef6fc853a259401b8c4b69735f2aa: Status 404 returned error can't find the container with id ca692d2f58589c93cd3cafefc4b4455f5a6ef6fc853a259401b8c4b69735f2aa Jun 10 00:24:32.797126 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.797096 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ddq87"] Jun 10 00:24:32.800124 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:32.800094 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8502e466_d3ff_4a34_8c54_7f7ccac29760.slice/crio-7569e831b3dbf2caa631a97980919a4ccaca1afc19aaba44543192db6c5c5c33 WatchSource:0}: Error finding container 7569e831b3dbf2caa631a97980919a4ccaca1afc19aaba44543192db6c5c5c33: Status 404 returned error can't find the container with id 7569e831b3dbf2caa631a97980919a4ccaca1afc19aaba44543192db6c5c5c33 Jun 10 00:24:32.933404 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.933373 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d"] Jun 10 00:24:32.936325 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:32.936296 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232f4fd7_2bbd_467f_864e_95c9722888c0.slice/crio-dd50ae678848070e9eebd38e37cc43a1e230258775d84a5a38a3781ad0f15fdf WatchSource:0}: Error finding container dd50ae678848070e9eebd38e37cc43a1e230258775d84a5a38a3781ad0f15fdf: Status 404 returned error can't find the container with id dd50ae678848070e9eebd38e37cc43a1e230258775d84a5a38a3781ad0f15fdf Jun 10 00:24:32.985203 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.985162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:32.985425 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:32.985212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:32.985425 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.985336 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:24:32.985425 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.985344 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:32.985425 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.985409 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls podName:1e620195-320c-452a-876a-2b38cc4b27f3 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.985393295 +0000 UTC m=+182.031937136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2vkk" (UID: "1e620195-320c-452a-876a-2b38cc4b27f3") : secret "samples-operator-tls" not found Jun 10 00:24:32.985425 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:32.985422 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.985416021 +0000 UTC m=+182.031959862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:33.123891 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.123846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" event={"ID":"5675b030-ea93-41cc-8c77-4bcc7519d79d","Type":"ContainerStarted","Data":"ca692d2f58589c93cd3cafefc4b4455f5a6ef6fc853a259401b8c4b69735f2aa"} Jun 10 00:24:33.124858 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.124831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ddq87" event={"ID":"8502e466-d3ff-4a34-8c54-7f7ccac29760","Type":"ContainerStarted","Data":"7569e831b3dbf2caa631a97980919a4ccaca1afc19aaba44543192db6c5c5c33"} Jun 10 00:24:33.125889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.125869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" event={"ID":"232f4fd7-2bbd-467f-864e-95c9722888c0","Type":"ContainerStarted","Data":"dd50ae678848070e9eebd38e37cc43a1e230258775d84a5a38a3781ad0f15fdf"} Jun 10 00:24:33.126914 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.126895 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" event={"ID":"cb6f56d2-eaca-482d-bdd3-653381c31bb4","Type":"ContainerStarted","Data":"3cc9ac76925b84117afd46b43517c8d99d98fad60c57d7fd6d56632e6fa0235c"} Jun 10 00:24:33.995372 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.995076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:33.995372 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:33.995135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:33.995372 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:33.995283 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:24:33.995372 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:33.995350 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls podName:1e620195-320c-452a-876a-2b38cc4b27f3 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:35.995330302 +0000 UTC m=+184.041874147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2vkk" (UID: "1e620195-320c-452a-876a-2b38cc4b27f3") : secret "samples-operator-tls" not found Jun 10 00:24:33.996001 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:33.995283 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:33.996001 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:33.995746 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:35.995728262 +0000 UTC m=+184.042272106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:35.134273 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:35.134218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" event={"ID":"cb6f56d2-eaca-482d-bdd3-653381c31bb4","Type":"ContainerStarted","Data":"067a8c14dc0774816c1e87e0127226b53a8c7fea990a87fc828ca9981029c71f"} Jun 10 00:24:35.149304 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:35.149222 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zd6nv" podStartSLOduration=1.787297556 podStartE2EDuration="3.149202359s" totalImagesPullingTime="1.361904803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:35.148804277 +0000 UTC m=+183.195348140" watchObservedRunningTime="2026-06-10 00:24:35.149202359 +0000 UTC m=+183.195746230" Jun 10 00:24:36.013412 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:36.013370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:36.013589 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:36.013425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:36.013589 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:36.013555 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:36.013712 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:36.013606 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:24:36.013712 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:36.013633 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.013611827 +0000 UTC m=+188.060155679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:36.013712 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:36.013661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls podName:1e620195-320c-452a-876a-2b38cc4b27f3 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.013644913 +0000 UTC m=+188.060188770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2vkk" (UID: "1e620195-320c-452a-876a-2b38cc4b27f3") : secret "samples-operator-tls" not found Jun 10 00:24:37.141149 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.141119 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/0.log" Jun 10 00:24:37.141633 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.141159 2560 generic.go:356] "Generic (PLEG): container finished" podID="5675b030-ea93-41cc-8c77-4bcc7519d79d" containerID="a2464858389275f487a7931c21485dfb826dcd9c61b0037f3879417b9abf3b33" exitCode=255 Jun 10 00:24:37.141633 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.141255 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" event={"ID":"5675b030-ea93-41cc-8c77-4bcc7519d79d","Type":"ContainerDied","Data":"a2464858389275f487a7931c21485dfb826dcd9c61b0037f3879417b9abf3b33"} Jun 10 00:24:37.141633 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.141489 2560 scope.go:117] "RemoveContainer" containerID="a2464858389275f487a7931c21485dfb826dcd9c61b0037f3879417b9abf3b33" Jun 10 00:24:37.142902 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.142876 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ddq87" event={"ID":"8502e466-d3ff-4a34-8c54-7f7ccac29760","Type":"ContainerStarted","Data":"8a079fc017768501fe7c164cd2168b2fc6876abc73bf2db81579fef1fec7a2ec"} Jun 10 00:24:37.150253 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.145251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" event={"ID":"232f4fd7-2bbd-467f-864e-95c9722888c0","Type":"ContainerStarted","Data":"ca91a73a59997dc6f97601686eefcc352ac0ff28a89a41d0d36787bf9ed4da2f"} Jun 10 00:24:37.170984 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.170924 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" podStartSLOduration=1.7514769989999999 podStartE2EDuration="5.170903625s" totalImagesPullingTime="3.419426626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:37.169795892 +0000 UTC m=+185.216339757" watchObservedRunningTime="2026-06-10 00:24:37.170903625 +0000 UTC m=+185.217447489" Jun 10 00:24:37.186554 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.186505 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-ddq87" podStartSLOduration=1.6277987870000001 podStartE2EDuration="5.186488379s" totalImagesPullingTime="3.558689592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:37.186086771 +0000 UTC m=+185.232630651" watchObservedRunningTime="2026-06-10 00:24:37.186488379 +0000 UTC m=+185.233032241" Jun 10 00:24:37.706724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.706688 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz"] Jun 10 00:24:37.709865 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.709846 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" Jun 10 00:24:37.712183 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.712156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 00:24:37.712329 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.712157 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4kzkq\"" Jun 10 00:24:37.712329 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.712305 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 00:24:37.720290 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.720247 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz"] Jun 10 00:24:37.829357 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.829325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hcdk\" (UniqueName: \"kubernetes.io/projected/df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1-kube-api-access-9hcdk\") pod \"migrator-955ffdf5f-sgpxz\" (UID: \"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" Jun 10 00:24:37.930238 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.930200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hcdk\" (UniqueName: \"kubernetes.io/projected/df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1-kube-api-access-9hcdk\") pod \"migrator-955ffdf5f-sgpxz\" (UID: \"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" Jun 10 00:24:37.937924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:37.937888 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hcdk\" (UniqueName: \"kubernetes.io/projected/df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1-kube-api-access-9hcdk\") pod \"migrator-955ffdf5f-sgpxz\" (UID: \"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" Jun 10 00:24:38.019141 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.019028 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" Jun 10 00:24:38.150333 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.150306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/1.log" Jun 10 00:24:38.150739 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.150724 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/0.log" Jun 10 00:24:38.150798 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.150764 2560 generic.go:356] "Generic (PLEG): container finished" podID="5675b030-ea93-41cc-8c77-4bcc7519d79d" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" exitCode=255 Jun 10 00:24:38.150883 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.150859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" event={"ID":"5675b030-ea93-41cc-8c77-4bcc7519d79d","Type":"ContainerDied","Data":"adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0"} Jun 10 00:24:38.150941 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.150929 2560 scope.go:117] "RemoveContainer" containerID="a2464858389275f487a7931c21485dfb826dcd9c61b0037f3879417b9abf3b33" Jun 10 00:24:38.151113 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.151099 2560 scope.go:117] "RemoveContainer" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" Jun 10 00:24:38.151367 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:38.151328 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:24:38.157614 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:38.157586 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz"] Jun 10 00:24:38.160487 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:38.160462 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6c2bfc_2a9a_4217_b2c5_f1febb75d6f1.slice/crio-ff408c3fd93a5a7a3374c8403eda1f094c564387be4c1cb45ef5f79a138dfe19 WatchSource:0}: Error finding container ff408c3fd93a5a7a3374c8403eda1f094c564387be4c1cb45ef5f79a138dfe19: Status 404 returned error can't find the container with id ff408c3fd93a5a7a3374c8403eda1f094c564387be4c1cb45ef5f79a138dfe19 Jun 10 00:24:39.156138 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:39.156106 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/1.log" Jun 10 00:24:39.156609 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:39.156556 2560 scope.go:117] "RemoveContainer" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" Jun 10 00:24:39.156789 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:39.156761 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:24:39.157500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:39.157465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" event={"ID":"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1","Type":"ContainerStarted","Data":"ff408c3fd93a5a7a3374c8403eda1f094c564387be4c1cb45ef5f79a138dfe19"} Jun 10 00:24:40.053512 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.053469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:40.053707 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.053517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:40.053707 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:40.053640 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:40.053819 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:40.053721 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.053703753 +0000 UTC m=+196.100247599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:40.053819 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:40.053719 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:24:40.053819 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:40.053798 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls podName:1e620195-320c-452a-876a-2b38cc4b27f3 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.053779098 +0000 UTC m=+196.100322951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2vkk" (UID: "1e620195-320c-452a-876a-2b38cc4b27f3") : secret "samples-operator-tls" not found Jun 10 00:24:40.118454 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.118420 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8qnmd"] Jun 10 00:24:40.121586 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.121567 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.124274 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.124234 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 00:24:40.125235 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.125215 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n8ctd\"" Jun 10 00:24:40.125340 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.125253 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 00:24:40.125340 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.125215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 00:24:40.125340 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.125217 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 00:24:40.128188 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.128156 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8qnmd"] Jun 10 00:24:40.161973 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.161936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" event={"ID":"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1","Type":"ContainerStarted","Data":"bfde5925e30815fff31f7b3cc79fde40b7e0615b0a0cd34e3716e1f601b11d9d"} Jun 10 00:24:40.162415 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.161988 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" event={"ID":"df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1","Type":"ContainerStarted","Data":"19fe155d0983d3eed4f806c46e93e6644d163138acdd6bb98bdec12b17002b4c"} Jun 10 00:24:40.176503 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.176449 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sgpxz" podStartSLOduration=1.685885286 podStartE2EDuration="3.176430787s" totalImagesPullingTime="1.490545501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:40.175237792 +0000 UTC m=+188.221781655" watchObservedRunningTime="2026-06-10 00:24:40.176430787 +0000 UTC m=+188.222974681" Jun 10 00:24:40.255987 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.255946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0271738a-ce83-4e6b-858d-3637106961a1-signing-key\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.256117 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.255995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf6j7\" (UniqueName: \"kubernetes.io/projected/0271738a-ce83-4e6b-858d-3637106961a1-kube-api-access-sf6j7\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.256117 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.256066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0271738a-ce83-4e6b-858d-3637106961a1-signing-cabundle\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.357462 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.357363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0271738a-ce83-4e6b-858d-3637106961a1-signing-key\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.357462 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.357405 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf6j7\" (UniqueName: \"kubernetes.io/projected/0271738a-ce83-4e6b-858d-3637106961a1-kube-api-access-sf6j7\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.357462 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.357441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0271738a-ce83-4e6b-858d-3637106961a1-signing-cabundle\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.358075 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.358057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0271738a-ce83-4e6b-858d-3637106961a1-signing-cabundle\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.359733 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.359714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0271738a-ce83-4e6b-858d-3637106961a1-signing-key\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.367540 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.367520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf6j7\" (UniqueName: \"kubernetes.io/projected/0271738a-ce83-4e6b-858d-3637106961a1-kube-api-access-sf6j7\") pod \"service-ca-7d74d578b8-8qnmd\" (UID: \"0271738a-ce83-4e6b-858d-3637106961a1\") " pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.431147 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.431101 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" Jun 10 00:24:40.556107 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:40.556075 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8qnmd"] Jun 10 00:24:40.559347 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:40.559320 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0271738a_ce83_4e6b_858d_3637106961a1.slice/crio-5f72e1af5312d8ba04c5b99002d6ad95f5ba0a6381df819e7318eaf218d99f7c WatchSource:0}: Error finding container 5f72e1af5312d8ba04c5b99002d6ad95f5ba0a6381df819e7318eaf218d99f7c: Status 404 returned error can't find the container with id 5f72e1af5312d8ba04c5b99002d6ad95f5ba0a6381df819e7318eaf218d99f7c Jun 10 00:24:41.051032 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:41.051004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wd98q_dee347e3-515f-4143-a61c-46bcd4f56d22/dns-node-resolver/0.log" Jun 10 00:24:41.167511 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:41.167469 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" event={"ID":"0271738a-ce83-4e6b-858d-3637106961a1","Type":"ContainerStarted","Data":"3354441ddd80520711fba2a33ecae4d5f87c448402391321d36631627e908272"} Jun 10 00:24:41.167907 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:41.167533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" event={"ID":"0271738a-ce83-4e6b-858d-3637106961a1","Type":"ContainerStarted","Data":"5f72e1af5312d8ba04c5b99002d6ad95f5ba0a6381df819e7318eaf218d99f7c"} Jun 10 00:24:41.183861 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:41.183807 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-8qnmd" podStartSLOduration=1.183790868 podStartE2EDuration="1.183790868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:41.183406101 +0000 UTC m=+189.229949988" watchObservedRunningTime="2026-06-10 00:24:41.183790868 +0000 UTC m=+189.230334731" Jun 10 00:24:41.850080 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:41.850051 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j874n_cd05a87e-1be8-4bf7-8473-682fc3207ce7/node-ca/0.log" Jun 10 00:24:42.581838 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:42.581799 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:42.582355 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:42.581870 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:24:42.582355 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:42.582302 2560 scope.go:117] "RemoveContainer" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" Jun 10 00:24:42.582512 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:42.582481 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:24:42.651562 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:42.651526 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kl2vz_51d97a1a-b9c0-4d9c-a462-aca1e9abda84/serve-healthcheck-canary/0.log" Jun 10 00:24:43.050348 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:43.050321 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sgpxz_df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1/migrator/0.log" Jun 10 00:24:43.250271 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:43.250224 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sgpxz_df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1/graceful-termination/0.log" Jun 10 00:24:48.126726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.126675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:24:48.126726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.126732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:48.127355 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:48.126836 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:48.127355 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:48.126910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls podName:73cf0f13-17aa-4d2d-a729-2e2e0ab981b6 nodeName:}" failed. No retries permitted until 2026-06-10 00:25:04.126894061 +0000 UTC m=+212.173437907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9rl6l" (UID: "73cf0f13-17aa-4d2d-a729-2e2e0ab981b6") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:24:48.129231 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.129211 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e620195-320c-452a-876a-2b38cc4b27f3-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2vkk\" (UID: \"1e620195-320c-452a-876a-2b38cc4b27f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:48.152110 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.152076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jvjxj\"" Jun 10 00:24:48.160057 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.160032 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" Jun 10 00:24:48.284997 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:48.284965 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk"] Jun 10 00:24:49.198312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:49.198272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" event={"ID":"1e620195-320c-452a-876a-2b38cc4b27f3","Type":"ContainerStarted","Data":"0dde5673d1eda3ce62a95d0dbe13a4228dbf621845a598b0604acfd56672252d"} Jun 10 00:24:51.206888 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:51.206840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" event={"ID":"1e620195-320c-452a-876a-2b38cc4b27f3","Type":"ContainerStarted","Data":"5b42cedb273315c885c5b97959c5b212b1c50097530d205a2121070dcd428c79"} Jun 10 00:24:51.207376 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:51.206912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" event={"ID":"1e620195-320c-452a-876a-2b38cc4b27f3","Type":"ContainerStarted","Data":"cc9131079ea07c9488f5102d0a2006bd7e69cce31d12285e849b8a9dcf7ba843"} Jun 10 00:24:51.222228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:51.222171 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2vkk" podStartSLOduration=17.242529469 podStartE2EDuration="19.222153724s" totalImagesPullingTime="1.979624255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:51.221383988 +0000 UTC m=+199.267927852" watchObservedRunningTime="2026-06-10 00:24:51.222153724 +0000 UTC m=+199.268697648" Jun 10 00:24:56.440077 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:56.440036 2560 scope.go:117] "RemoveContainer" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" Jun 10 00:24:57.225384 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.225357 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:24:57.225765 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.225746 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/1.log" Jun 10 00:24:57.225875 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.225788 2560 generic.go:356] "Generic (PLEG): container finished" podID="5675b030-ea93-41cc-8c77-4bcc7519d79d" containerID="d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd" exitCode=255 Jun 10 00:24:57.225875 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.225857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" event={"ID":"5675b030-ea93-41cc-8c77-4bcc7519d79d","Type":"ContainerDied","Data":"d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd"} Jun 10 00:24:57.225969 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.225910 2560 scope.go:117] "RemoveContainer" containerID="adaa20498205cc9a1584ca19c4f60c8ba51dd41e4fe5697d6c05a787a86b1db0" Jun 10 00:24:57.226220 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:57.226203 2560 scope.go:117] "RemoveContainer" containerID="d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd" Jun 10 00:24:57.226433 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:24:57.226412 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:24:58.230771 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:58.230743 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:24:59.481180 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.481145 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lhmg7"] Jun 10 00:24:59.485564 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.485539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.489608 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.489588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qttn\"" Jun 10 00:24:59.490481 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.490467 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 00:24:59.490549 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.490479 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 00:24:59.503460 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.503426 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhmg7"] Jun 10 00:24:59.625759 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.625726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/898872ad-556e-4326-9c00-eff70cda55ec-kube-api-access-sv76v\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.625924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.625791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/898872ad-556e-4326-9c00-eff70cda55ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.625924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.625865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/898872ad-556e-4326-9c00-eff70cda55ec-crio-socket\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.625924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.625902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/898872ad-556e-4326-9c00-eff70cda55ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.626079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.625940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/898872ad-556e-4326-9c00-eff70cda55ec-data-volume\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726387 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/898872ad-556e-4326-9c00-eff70cda55ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726581 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/898872ad-556e-4326-9c00-eff70cda55ec-crio-socket\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726581 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726431 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/898872ad-556e-4326-9c00-eff70cda55ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726699 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/898872ad-556e-4326-9c00-eff70cda55ec-data-volume\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726751 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/898872ad-556e-4326-9c00-eff70cda55ec-crio-socket\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726791 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/898872ad-556e-4326-9c00-eff70cda55ec-kube-api-access-sv76v\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.726999 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.726977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/898872ad-556e-4326-9c00-eff70cda55ec-data-volume\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.727131 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.727110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/898872ad-556e-4326-9c00-eff70cda55ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.728808 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.728779 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/898872ad-556e-4326-9c00-eff70cda55ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.737354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.737255 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/898872ad-556e-4326-9c00-eff70cda55ec-kube-api-access-sv76v\") pod \"insights-runtime-extractor-lhmg7\" (UID: \"898872ad-556e-4326-9c00-eff70cda55ec\") " pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.794451 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.794406 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhmg7" Jun 10 00:24:59.927133 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:24:59.927090 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhmg7"] Jun 10 00:24:59.930457 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:24:59.930423 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898872ad_556e_4326_9c00_eff70cda55ec.slice/crio-2f291a29b7aac1374f04c675b90251394a603d62c02ac126d29a0cb56d312b3f WatchSource:0}: Error finding container 2f291a29b7aac1374f04c675b90251394a603d62c02ac126d29a0cb56d312b3f: Status 404 returned error can't find the container with id 2f291a29b7aac1374f04c675b90251394a603d62c02ac126d29a0cb56d312b3f Jun 10 00:25:00.238841 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:00.238748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhmg7" event={"ID":"898872ad-556e-4326-9c00-eff70cda55ec","Type":"ContainerStarted","Data":"227c10742d822c0192c3d21b8fb2d7e80d80c4d6d820c6e99f1df0a3f78cf328"} Jun 10 00:25:00.238841 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:00.238809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhmg7" event={"ID":"898872ad-556e-4326-9c00-eff70cda55ec","Type":"ContainerStarted","Data":"2f291a29b7aac1374f04c675b90251394a603d62c02ac126d29a0cb56d312b3f"} Jun 10 00:25:01.245181 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:01.245132 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhmg7" event={"ID":"898872ad-556e-4326-9c00-eff70cda55ec","Type":"ContainerStarted","Data":"8bc20ad70a6205f68481b62a1706019e94637fe8dae1c50b37e9617f73753c1e"} Jun 10 00:25:02.250646 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:02.250601 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhmg7" event={"ID":"898872ad-556e-4326-9c00-eff70cda55ec","Type":"ContainerStarted","Data":"18635850785e13c2bcc1d42f99da8df5553acc19f3a83487bba8c7426b119ac7"} Jun 10 00:25:02.268463 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:02.268406 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lhmg7" podStartSLOduration=1.241567063 podStartE2EDuration="3.268390469s" totalImagesPullingTime="2.026823406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:24:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:02.268208316 +0000 UTC m=+210.314752178" watchObservedRunningTime="2026-06-10 00:25:02.268390469 +0000 UTC m=+210.314934331" Jun 10 00:25:02.582166 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:02.582128 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:25:02.582338 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:02.582193 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:25:02.582532 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:02.582520 2560 scope.go:117] "RemoveContainer" containerID="d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd" Jun 10 00:25:02.582706 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:02.582688 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:25:04.167192 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:04.167129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:25:04.169561 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:04.169539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/73cf0f13-17aa-4d2d-a729-2e2e0ab981b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9rl6l\" (UID: \"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:25:04.463576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:04.463476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" Jun 10 00:25:04.596307 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:04.596254 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l"] Jun 10 00:25:04.599281 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:04.599236 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cf0f13_17aa_4d2d_a729_2e2e0ab981b6.slice/crio-d2165db63d4ca555c1d8978393ce280491a44e8109ebcf7fe4e798e9549bb27a WatchSource:0}: Error finding container d2165db63d4ca555c1d8978393ce280491a44e8109ebcf7fe4e798e9549bb27a: Status 404 returned error can't find the container with id d2165db63d4ca555c1d8978393ce280491a44e8109ebcf7fe4e798e9549bb27a Jun 10 00:25:05.260347 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:05.260303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" event={"ID":"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6","Type":"ContainerStarted","Data":"d2165db63d4ca555c1d8978393ce280491a44e8109ebcf7fe4e798e9549bb27a"} Jun 10 00:25:07.268344 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:07.268306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" event={"ID":"73cf0f13-17aa-4d2d-a729-2e2e0ab981b6","Type":"ContainerStarted","Data":"94e677598af43c338cc84ac0fb532cc1375cf6d7d4dbda50c98d7d7552d32374"} Jun 10 00:25:07.287137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:07.287064 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9rl6l" podStartSLOduration=33.114712 podStartE2EDuration="35.287042218s" totalImagesPullingTime="2.172330218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:07.285716952 +0000 UTC m=+215.332260817" watchObservedRunningTime="2026-06-10 00:25:07.287042218 +0000 UTC m=+215.333586084" Jun 10 00:25:11.322450 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.322409 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv"] Jun 10 00:25:11.387096 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.387050 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv"] Jun 10 00:25:11.387306 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.387204 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.390118 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.390098 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 00:25:11.390347 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.390334 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cf25d\"" Jun 10 00:25:11.391272 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.391243 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 00:25:11.391352 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.391243 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 00:25:11.423072 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.423029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzkx\" (UniqueName: \"kubernetes.io/projected/542f90a0-746c-4044-a588-a9ea58af30ec-kube-api-access-qvzkx\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.423254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.423151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/542f90a0-746c-4044-a588-a9ea58af30ec-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.423254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.423181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.423361 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.423286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.524166 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.524115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/542f90a0-746c-4044-a588-a9ea58af30ec-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.524395 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.524181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.524395 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.524239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.524395 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.524300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzkx\" (UniqueName: \"kubernetes.io/projected/542f90a0-746c-4044-a588-a9ea58af30ec-kube-api-access-qvzkx\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.524395 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:11.524303 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 00:25:11.524395 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:11.524378 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls podName:542f90a0-746c-4044-a588-a9ea58af30ec nodeName:}" failed. No retries permitted until 2026-06-10 00:25:12.024357632 +0000 UTC m=+220.070901478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-gjfpv" (UID: "542f90a0-746c-4044-a588-a9ea58af30ec") : secret "prometheus-operator-tls" not found Jun 10 00:25:11.524914 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.524894 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/542f90a0-746c-4044-a588-a9ea58af30ec-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.526649 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.526626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:11.534967 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:11.534938 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzkx\" (UniqueName: \"kubernetes.io/projected/542f90a0-746c-4044-a588-a9ea58af30ec-kube-api-access-qvzkx\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:12.028894 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:12.028851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:12.031329 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:12.031309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/542f90a0-746c-4044-a588-a9ea58af30ec-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gjfpv\" (UID: \"542f90a0-746c-4044-a588-a9ea58af30ec\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:12.296653 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:12.296629 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" Jun 10 00:25:12.437484 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:12.437450 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv"] Jun 10 00:25:12.440480 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:12.440447 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542f90a0_746c_4044_a588_a9ea58af30ec.slice/crio-ab9ff694a00c6e493dea52bafe1a67601189e0cdb379ac83ff2997ebfee55d06 WatchSource:0}: Error finding container ab9ff694a00c6e493dea52bafe1a67601189e0cdb379ac83ff2997ebfee55d06: Status 404 returned error can't find the container with id ab9ff694a00c6e493dea52bafe1a67601189e0cdb379ac83ff2997ebfee55d06 Jun 10 00:25:13.296075 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:13.296032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" event={"ID":"542f90a0-746c-4044-a588-a9ea58af30ec","Type":"ContainerStarted","Data":"ab9ff694a00c6e493dea52bafe1a67601189e0cdb379ac83ff2997ebfee55d06"} Jun 10 00:25:14.301425 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:14.301391 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" event={"ID":"542f90a0-746c-4044-a588-a9ea58af30ec","Type":"ContainerStarted","Data":"41ace9ba2b039335962b82c4124908c1087d40b203e67608a54d3b35d8cb01ee"} Jun 10 00:25:14.301885 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:14.301445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" event={"ID":"542f90a0-746c-4044-a588-a9ea58af30ec","Type":"ContainerStarted","Data":"4baf9ddff8e7ee1f014c9c10e660a663940c615fd2c0bc49d750942df8ab38f1"} Jun 10 00:25:14.316988 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:14.316937 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gjfpv" podStartSLOduration=1.8483909710000002 podStartE2EDuration="3.316920117s" totalImagesPullingTime="1.468529146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:14.315602374 +0000 UTC m=+222.362146237" watchObservedRunningTime="2026-06-10 00:25:14.316920117 +0000 UTC m=+222.363463980" Jun 10 00:25:14.440387 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:14.440357 2560 scope.go:117] "RemoveContainer" containerID="d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd" Jun 10 00:25:14.440562 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:14.440526 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8hc24_openshift-console-operator(5675b030-ea93-41cc-8c77-4bcc7519d79d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" Jun 10 00:25:16.680889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.680857 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tkwwv"] Jun 10 00:25:16.684220 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.684197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.686576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.686426 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 00:25:16.686576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.686450 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-45hv7\"" Jun 10 00:25:16.686576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.686459 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 00:25:16.686576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.686540 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 00:25:16.763503 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-root\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763503 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763750 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-metrics-client-ca\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763750 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-textfile\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763750 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-sys\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763750 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-wtmp\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763942 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763942 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763873 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw5q2\" (UniqueName: \"kubernetes.io/projected/aedf11b8-3082-409d-8bd4-757d323d66db-kube-api-access-sw5q2\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.763942 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.763901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865303 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw5q2\" (UniqueName: \"kubernetes.io/projected/aedf11b8-3082-409d-8bd4-757d323d66db-kube-api-access-sw5q2\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-root\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-metrics-client-ca\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-root\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-textfile\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865542 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-sys\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-wtmp\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.865857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.865615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.866172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:16.866198 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.866245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-sys\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:25:16.866279 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls podName:aedf11b8-3082-409d-8bd4-757d323d66db nodeName:}" failed. No retries permitted until 2026-06-10 00:25:17.366244829 +0000 UTC m=+225.412788682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls") pod "node-exporter-tkwwv" (UID: "aedf11b8-3082-409d-8bd4-757d323d66db") : secret "node-exporter-tls" not found Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.866201 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aedf11b8-3082-409d-8bd4-757d323d66db-metrics-client-ca\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.866382 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-wtmp\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.866444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.866410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-textfile\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.868201 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.868178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:16.877233 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:16.877208 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw5q2\" (UniqueName: \"kubernetes.io/projected/aedf11b8-3082-409d-8bd4-757d323d66db-kube-api-access-sw5q2\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:17.371673 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:17.371627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:17.374575 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:17.374546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aedf11b8-3082-409d-8bd4-757d323d66db-node-exporter-tls\") pod \"node-exporter-tkwwv\" (UID: \"aedf11b8-3082-409d-8bd4-757d323d66db\") " pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:17.595126 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:17.595076 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tkwwv" Jun 10 00:25:17.610202 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:17.610170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedf11b8_3082_409d_8bd4_757d323d66db.slice/crio-abd57d85d54970846442cef37390b4d1e7eec9f6f65b8bd3eb9ed659b3b31fe8 WatchSource:0}: Error finding container abd57d85d54970846442cef37390b4d1e7eec9f6f65b8bd3eb9ed659b3b31fe8: Status 404 returned error can't find the container with id abd57d85d54970846442cef37390b4d1e7eec9f6f65b8bd3eb9ed659b3b31fe8 Jun 10 00:25:18.316441 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:18.316399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tkwwv" event={"ID":"aedf11b8-3082-409d-8bd4-757d323d66db","Type":"ContainerStarted","Data":"abd57d85d54970846442cef37390b4d1e7eec9f6f65b8bd3eb9ed659b3b31fe8"} Jun 10 00:25:19.321604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:19.321560 2560 generic.go:356] "Generic (PLEG): container finished" podID="aedf11b8-3082-409d-8bd4-757d323d66db" containerID="8a461d306e4499eb87dd02410895acb0730b41d062db4ec39c1dc68562e80705" exitCode=0 Jun 10 00:25:19.322017 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:19.321645 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tkwwv" event={"ID":"aedf11b8-3082-409d-8bd4-757d323d66db","Type":"ContainerDied","Data":"8a461d306e4499eb87dd02410895acb0730b41d062db4ec39c1dc68562e80705"} Jun 10 00:25:20.327608 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:20.327572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tkwwv" event={"ID":"aedf11b8-3082-409d-8bd4-757d323d66db","Type":"ContainerStarted","Data":"dff0f546e572a03e645c69e25d8de183026ea9d066df728bcce7118b127e5194"} Jun 10 00:25:20.328073 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:20.327626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tkwwv" event={"ID":"aedf11b8-3082-409d-8bd4-757d323d66db","Type":"ContainerStarted","Data":"45c3365c3bdd1088dc0f0cbe4b318f3f0ab2bdc9ebe2a901ffb2a7c67b512380"} Jun 10 00:25:20.346167 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:20.346116 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tkwwv" podStartSLOduration=3.371817079 podStartE2EDuration="4.346082214s" totalImagesPullingTime="904.338443ms" totalInitContainerRuntime="69.926692ms" isStatefulPod=true podCreationTimestamp="2026-06-10 00:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:20.345006983 +0000 UTC m=+228.391550857" watchObservedRunningTime="2026-06-10 00:25:20.346082214 +0000 UTC m=+228.392626124" Jun 10 00:25:21.837025 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.836990 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-788d894b74-nttgm"] Jun 10 00:25:21.840567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.840549 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.842939 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.842912 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 00:25:21.843058 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.842997 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-clcqc\"" Jun 10 00:25:21.843058 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.843012 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 00:25:21.843058 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.842915 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 00:25:21.843230 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.843062 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 00:25:21.843348 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.843333 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 00:25:21.852472 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.852445 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 00:25:21.852600 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.852529 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-788d894b74-nttgm"] Jun 10 00:25:21.909889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.909850 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-serving-certs-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.909889 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.909891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-metrics-client-ca\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910147 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.909924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910147 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.910045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910147 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.910121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcns\" (UniqueName: \"kubernetes.io/projected/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-kube-api-access-phcns\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910391 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.910157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910391 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.910202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:21.910391 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:21.910249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-federate-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011134 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcns\" (UniqueName: \"kubernetes.io/projected/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-kube-api-access-phcns\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-federate-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011572 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-serving-certs-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011572 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-metrics-client-ca\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.011572 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.011481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.012228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.012147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-serving-certs-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.012228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.012178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.012228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.012197 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-metrics-client-ca\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.013915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.013896 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-telemeter-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.014003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.013903 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.014235 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.014217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-secret-telemeter-client\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.014466 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.014446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-federate-client-tls\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.019472 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.019456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcns\" (UniqueName: \"kubernetes.io/projected/cbe1d61b-6dfd-4c99-9133-b0ce5d61034f-kube-api-access-phcns\") pod \"telemeter-client-788d894b74-nttgm\" (UID: \"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f\") " pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.155255 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.155168 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" Jun 10 00:25:22.288456 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.288403 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-788d894b74-nttgm"] Jun 10 00:25:22.290553 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:22.290528 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe1d61b_6dfd_4c99_9133_b0ce5d61034f.slice/crio-f506ba42a01fa42ee75955d912dc7e9465a2929f63e8de4bfbb461f7630f1a51 WatchSource:0}: Error finding container f506ba42a01fa42ee75955d912dc7e9465a2929f63e8de4bfbb461f7630f1a51: Status 404 returned error can't find the container with id f506ba42a01fa42ee75955d912dc7e9465a2929f63e8de4bfbb461f7630f1a51 Jun 10 00:25:22.338282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.338228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" event={"ID":"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f","Type":"ContainerStarted","Data":"f506ba42a01fa42ee75955d912dc7e9465a2929f63e8de4bfbb461f7630f1a51"} Jun 10 00:25:22.857522 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.857483 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:25:22.863233 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.863206 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.865561 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.865974 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.866155 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.866440 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-agh7g2t0or8qq\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.866810 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.866997 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sw5kg\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867224 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867442 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 00:25:22.867643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867620 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 00:25:22.868176 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 00:25:22.868176 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867896 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 00:25:22.868176 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867922 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 00:25:22.868176 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.868044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 00:25:22.868176 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.867883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 00:25:22.868428 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.868192 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 00:25:22.868428 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.868225 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 00:25:22.869639 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.869622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 00:25:22.876495 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.876469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:25:22.920117 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lczw\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920312 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.920623 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.921053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920643 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.921053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.921053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:22.921053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:22.920737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023318 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023397 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023524 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023747 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023747 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023747 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.023906 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.023983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lczw\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024139 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024533 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.024621 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.024954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.025147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.025174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.026504 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.026593 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.026710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.026598 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.028703 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.027108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.028703 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.028288 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.029156 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.029098 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.030089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.029671 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.031102 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.031068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.031339 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.031312 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.031687 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.031632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.031687 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.031637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.032932 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.032906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.033039 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.033018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.033125 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.033103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.034026 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.034008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lczw\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw\") pod \"prometheus-k8s-0\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.177143 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.177065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:23.361607 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:23.361539 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:25:23.364752 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:23.364722 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6260c9ad_6c50_41f5_bcbe_62a2583b8146.slice/crio-a2a755fcb09bac46972dc18d8c1a2ffdb2d199c5aa584ca5a6bd281594d7183a WatchSource:0}: Error finding container a2a755fcb09bac46972dc18d8c1a2ffdb2d199c5aa584ca5a6bd281594d7183a: Status 404 returned error can't find the container with id a2a755fcb09bac46972dc18d8c1a2ffdb2d199c5aa584ca5a6bd281594d7183a Jun 10 00:25:24.350567 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:24.350516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"a2a755fcb09bac46972dc18d8c1a2ffdb2d199c5aa584ca5a6bd281594d7183a"} Jun 10 00:25:25.358429 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.358390 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" event={"ID":"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f","Type":"ContainerStarted","Data":"0727bd56d677b733702d33994e5a17b993011d84fd153d3ccf7ae30e573a05bd"} Jun 10 00:25:25.358886 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.358451 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" event={"ID":"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f","Type":"ContainerStarted","Data":"7cb241eead8a4e0e947f28c8d066de953e126f3850ab2a5be2ddf17fe4ab8d21"} Jun 10 00:25:25.358886 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.358479 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" event={"ID":"cbe1d61b-6dfd-4c99-9133-b0ce5d61034f","Type":"ContainerStarted","Data":"b1dda267e23fd256a2b01335d0365a3be7cdd67dcfb29dfe6894962658ca3951"} Jun 10 00:25:25.359919 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.359893 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" exitCode=0 Jun 10 00:25:25.360018 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.359973 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} Jun 10 00:25:25.380090 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:25.379969 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-788d894b74-nttgm" podStartSLOduration=1.6848185039999999 podStartE2EDuration="4.379949136s" totalImagesPullingTime="2.695130632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:25.378073615 +0000 UTC m=+233.424617478" watchObservedRunningTime="2026-06-10 00:25:25.379949136 +0000 UTC m=+233.426493003" Jun 10 00:25:28.440138 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:28.440102 2560 scope.go:117] "RemoveContainer" containerID="d67a75b06e0786976f311520b968a719f7d0d2ed05826048e48bf4905eaf92bd" Jun 10 00:25:29.378367 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.378336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} Jun 10 00:25:29.380391 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.380366 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:25:29.380489 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.380445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" event={"ID":"5675b030-ea93-41cc-8c77-4bcc7519d79d","Type":"ContainerStarted","Data":"397175d4a60d59d00923bc171af4f1f044a8592001701fa053ec61bbcb4b62d8"} Jun 10 00:25:29.380935 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.380766 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:25:29.382937 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.382082 2560 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-8hc24 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jun 10 00:25:29.382937 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.382130 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podUID="5675b030-ea93-41cc-8c77-4bcc7519d79d" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jun 10 00:25:29.396241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:29.396190 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" podStartSLOduration=53.774581102 podStartE2EDuration="57.396167965s" totalImagesPullingTime="3.621586863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:29.394609385 +0000 UTC m=+237.441153273" watchObservedRunningTime="2026-06-10 00:25:29.396167965 +0000 UTC m=+237.442711834" Jun 10 00:25:30.386277 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:30.386229 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} Jun 10 00:25:30.390411 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:30.390384 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-8hc24" Jun 10 00:25:32.397752 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:32.397712 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} Jun 10 00:25:32.398193 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:32.397822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} Jun 10 00:25:32.398193 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:32.397869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} Jun 10 00:25:32.398193 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:32.397912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerStarted","Data":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} Jun 10 00:25:32.423423 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:32.423302 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.35495308 podStartE2EDuration="10.423279875s" totalImagesPullingTime="8.048680058s" totalInitContainerRuntime="19.646737ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:32.421716327 +0000 UTC m=+240.468260189" watchObservedRunningTime="2026-06-10 00:25:32.423279875 +0000 UTC m=+240.469823755" Jun 10 00:25:33.177996 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:33.177961 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:25:43.413152 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:43.413103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:25:43.415496 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:43.415466 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96a93ca9-0162-4610-89ee-96b20937fdbf-metrics-certs\") pod \"network-metrics-daemon-pm8pj\" (UID: \"96a93ca9-0162-4610-89ee-96b20937fdbf\") " pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:25:43.443152 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:43.443118 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8r5c2\"" Jun 10 00:25:43.450972 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:43.450944 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pm8pj" Jun 10 00:25:43.578755 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:43.578698 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pm8pj"] Jun 10 00:25:43.581604 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:25:43.581561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a93ca9_0162_4610_89ee_96b20937fdbf.slice/crio-e6183aef057893e889d0eb1e171c015c10070c5b17c429646757fe6f547a3a78 WatchSource:0}: Error finding container e6183aef057893e889d0eb1e171c015c10070c5b17c429646757fe6f547a3a78: Status 404 returned error can't find the container with id e6183aef057893e889d0eb1e171c015c10070c5b17c429646757fe6f547a3a78 Jun 10 00:25:44.449572 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:44.446246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pm8pj" event={"ID":"96a93ca9-0162-4610-89ee-96b20937fdbf","Type":"ContainerStarted","Data":"e6183aef057893e889d0eb1e171c015c10070c5b17c429646757fe6f547a3a78"} Jun 10 00:25:45.448944 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:45.448904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pm8pj" event={"ID":"96a93ca9-0162-4610-89ee-96b20937fdbf","Type":"ContainerStarted","Data":"fcaab8ec7685c206fe39cc77d6a2bfdeed5972c1cc40ce438356bee812c29264"} Jun 10 00:25:45.449121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:45.448971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pm8pj" event={"ID":"96a93ca9-0162-4610-89ee-96b20937fdbf","Type":"ContainerStarted","Data":"f6b2348b89361e8e69df076432fe93ba47011476491a5d854ad95a581a20871c"} Jun 10 00:25:45.467362 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:45.467308 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pm8pj" podStartSLOduration=252.573537377 podStartE2EDuration="4m13.467290263s" totalImagesPullingTime="893.752886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:45.465816103 +0000 UTC m=+253.512359986" watchObservedRunningTime="2026-06-10 00:25:45.467290263 +0000 UTC m=+253.513834126" Jun 10 00:25:57.497420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:57.497380 2560 generic.go:356] "Generic (PLEG): container finished" podID="232f4fd7-2bbd-467f-864e-95c9722888c0" containerID="ca91a73a59997dc6f97601686eefcc352ac0ff28a89a41d0d36787bf9ed4da2f" exitCode=0 Jun 10 00:25:57.497786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:57.497452 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" event={"ID":"232f4fd7-2bbd-467f-864e-95c9722888c0","Type":"ContainerDied","Data":"ca91a73a59997dc6f97601686eefcc352ac0ff28a89a41d0d36787bf9ed4da2f"} Jun 10 00:25:57.497828 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:57.497795 2560 scope.go:117] "RemoveContainer" containerID="ca91a73a59997dc6f97601686eefcc352ac0ff28a89a41d0d36787bf9ed4da2f" Jun 10 00:25:58.503700 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:25:58.503661 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-5zm2d" event={"ID":"232f4fd7-2bbd-467f-864e-95c9722888c0","Type":"ContainerStarted","Data":"124e09c763e7bdc78e98ae0781e60d9b8a65f3786f8ad83db07b8bb87283a68b"} Jun 10 00:26:02.518817 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:02.518780 2560 generic.go:356] "Generic (PLEG): container finished" podID="8502e466-d3ff-4a34-8c54-7f7ccac29760" containerID="8a079fc017768501fe7c164cd2168b2fc6876abc73bf2db81579fef1fec7a2ec" exitCode=0 Jun 10 00:26:02.519220 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:02.518852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ddq87" event={"ID":"8502e466-d3ff-4a34-8c54-7f7ccac29760","Type":"ContainerDied","Data":"8a079fc017768501fe7c164cd2168b2fc6876abc73bf2db81579fef1fec7a2ec"} Jun 10 00:26:02.519220 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:02.519204 2560 scope.go:117] "RemoveContainer" containerID="8a079fc017768501fe7c164cd2168b2fc6876abc73bf2db81579fef1fec7a2ec" Jun 10 00:26:03.529465 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:03.529428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ddq87" event={"ID":"8502e466-d3ff-4a34-8c54-7f7ccac29760","Type":"ContainerStarted","Data":"1937c58f7209339d0071498ff160894c50c801cc3ae4bd5ae6072be63bfc3319"} Jun 10 00:26:06.660663 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:06.660631 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-9rl6l_73cf0f13-17aa-4d2d-a729-2e2e0ab981b6/cluster-monitoring-operator/0.log" Jun 10 00:26:08.458158 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:08.458130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/init-textfile/0.log" Jun 10 00:26:08.659490 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:08.659462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/node-exporter/0.log" Jun 10 00:26:08.859282 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:08.859223 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/kube-rbac-proxy/0.log" Jun 10 00:26:10.259377 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:10.259346 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/init-config-reloader/0.log" Jun 10 00:26:10.459710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:10.459686 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/prometheus/0.log" Jun 10 00:26:10.659009 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:10.658984 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/config-reloader/0.log" Jun 10 00:26:10.859596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:10.859566 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/thanos-sidecar/0.log" Jun 10 00:26:11.059403 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:11.059382 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/kube-rbac-proxy-web/0.log" Jun 10 00:26:11.259226 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:11.259197 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/kube-rbac-proxy/0.log" Jun 10 00:26:11.459388 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:11.459309 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6260c9ad-6c50-41f5-bcbe-62a2583b8146/kube-rbac-proxy-thanos/0.log" Jun 10 00:26:11.659575 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:11.659543 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gjfpv_542f90a0-746c-4044-a588-a9ea58af30ec/prometheus-operator/0.log" Jun 10 00:26:11.859458 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:11.859429 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gjfpv_542f90a0-746c-4044-a588-a9ea58af30ec/kube-rbac-proxy/0.log" Jun 10 00:26:12.259645 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:12.259567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/telemeter-client/0.log" Jun 10 00:26:12.459354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:12.459327 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/reload/0.log" Jun 10 00:26:12.659424 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:12.659394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/kube-rbac-proxy/0.log" Jun 10 00:26:14.259006 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:14.258976 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:26:14.460985 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:14.460960 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/3.log" Jun 10 00:26:15.069847 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:15.069799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9gfx5" podUID="0c017017-a832-4419-bb15-ccb04cbf1b1e" Jun 10 00:26:15.577569 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:15.577540 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:16.858988 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:16.858959 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wd98q_dee347e3-515f-4143-a61c-46bcd4f56d22/dns-node-resolver/0.log" Jun 10 00:26:17.658748 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:17.658719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j874n_cd05a87e-1be8-4bf7-8473-682fc3207ce7/node-ca/0.log" Jun 10 00:26:18.323484 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.323441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:18.323876 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.323545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:26:18.325910 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.325874 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c017017-a832-4419-bb15-ccb04cbf1b1e-metrics-tls\") pod \"dns-default-9gfx5\" (UID: \"0c017017-a832-4419-bb15-ccb04cbf1b1e\") " pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:18.326028 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.325944 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"image-registry-768d88cbc8-qjjd8\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:26:18.343184 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.343159 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5ppl\"" Jun 10 00:26:18.351250 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.351226 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:26:18.458940 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.458915 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kl2vz_51d97a1a-b9c0-4d9c-a462-aca1e9abda84/serve-healthcheck-canary/0.log" Jun 10 00:26:18.520773 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.520748 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:26:18.522584 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:26:18.522547 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef91a83_8228_403a_ad25_c2938857130f.slice/crio-5b248a5d3e48ee396843fa5431fdc2f0a5621e4459275513360d3bfcef91540d WatchSource:0}: Error finding container 5b248a5d3e48ee396843fa5431fdc2f0a5621e4459275513360d3bfcef91540d: Status 404 returned error can't find the container with id 5b248a5d3e48ee396843fa5431fdc2f0a5621e4459275513360d3bfcef91540d Jun 10 00:26:18.581141 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.581118 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vpwdb\"" Jun 10 00:26:18.589284 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.589237 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:18.590507 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.590482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" event={"ID":"aef91a83-8228-403a-ad25-c2938857130f","Type":"ContainerStarted","Data":"5b248a5d3e48ee396843fa5431fdc2f0a5621e4459275513360d3bfcef91540d"} Jun 10 00:26:18.740565 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:18.740532 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9gfx5"] Jun 10 00:26:18.743731 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:26:18.743699 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c017017_a832_4419_bb15_ccb04cbf1b1e.slice/crio-fa14a1bbd286d14490190639d5c1e1227efba303ab3cb67f0b712b8b6053beba WatchSource:0}: Error finding container fa14a1bbd286d14490190639d5c1e1227efba303ab3cb67f0b712b8b6053beba: Status 404 returned error can't find the container with id fa14a1bbd286d14490190639d5c1e1227efba303ab3cb67f0b712b8b6053beba Jun 10 00:26:19.595888 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:19.595851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9gfx5" event={"ID":"0c017017-a832-4419-bb15-ccb04cbf1b1e","Type":"ContainerStarted","Data":"fa14a1bbd286d14490190639d5c1e1227efba303ab3cb67f0b712b8b6053beba"} Jun 10 00:26:19.597459 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:19.597429 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" event={"ID":"aef91a83-8228-403a-ad25-c2938857130f","Type":"ContainerStarted","Data":"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30"} Jun 10 00:26:19.597590 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:19.597568 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:26:19.617073 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:19.617007 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" podStartSLOduration=286.616988949 podStartE2EDuration="4m46.616988949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:26:19.615871433 +0000 UTC m=+287.662415329" watchObservedRunningTime="2026-06-10 00:26:19.616988949 +0000 UTC m=+287.663532811" Jun 10 00:26:22.617558 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:22.617517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9gfx5" event={"ID":"0c017017-a832-4419-bb15-ccb04cbf1b1e","Type":"ContainerStarted","Data":"e768caf256f45b645cfeb0cd2b1bb410778521ba78d9f77fcf4cd5dc7aa4a129"} Jun 10 00:26:22.617993 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:22.617623 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:22.617993 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:22.617645 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9gfx5" event={"ID":"0c017017-a832-4419-bb15-ccb04cbf1b1e","Type":"ContainerStarted","Data":"4576ad0723af6c707ce5a9f79f894a356340499624e8778ff72abf676ac0fd1d"} Jun 10 00:26:22.633485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:22.633417 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9gfx5" podStartSLOduration=251.500899594 podStartE2EDuration="4m14.633391781s" totalImagesPullingTime="3.132492187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:26:22.632466411 +0000 UTC m=+290.679010295" watchObservedRunningTime="2026-06-10 00:26:22.633391781 +0000 UTC m=+290.679935645" Jun 10 00:26:23.177965 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:23.177914 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:23.198535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:23.198505 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:23.637797 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:23.637769 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:32.379652 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.379620 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:26:32.381968 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.381931 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:26:32.388153 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.388131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:26:32.390333 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.390311 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:26:32.391714 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.391680 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 00:26:32.624108 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:32.624074 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9gfx5" Jun 10 00:26:37.987509 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:37.987471 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:26:37.993354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:37.993324 2560 patch_prober.go:28] interesting pod/image-registry-768d88cbc8-qjjd8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:26:37.993501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:37.993379 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" podUID="aef91a83-8228-403a-ad25-c2938857130f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:26:41.223789 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.223750 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:41.224289 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224084 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="prometheus" containerID="cri-o://531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" gracePeriod=600 Jun 10 00:26:41.224289 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224113 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy" containerID="cri-o://fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" gracePeriod=600 Jun 10 00:26:41.224289 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224096 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-web" containerID="cri-o://6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" gracePeriod=600 Jun 10 00:26:41.224289 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224242 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" gracePeriod=600 Jun 10 00:26:41.224501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224291 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="thanos-sidecar" containerID="cri-o://5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" gracePeriod=600 Jun 10 00:26:41.224501 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.224087 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="config-reloader" containerID="cri-o://ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" gracePeriod=600 Jun 10 00:26:41.492335 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.492284 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.546442 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546409 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546453 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546493 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546517 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546543 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546577 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.546620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546600 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546632 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546661 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546691 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546723 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546755 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lczw\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546783 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546802 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546827 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546862 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546886 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546914 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546961 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.546995 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547021 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs\") pod \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\" (UID: \"6260c9ad-6c50-41f5-bcbe-62a2583b8146\") " Jun 10 00:26:41.547024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547022 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.547860 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547107 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.547860 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547341 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.547860 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547364 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.547860 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547380 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-metrics-client-ca\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.547860 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.547697 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.549076 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.548872 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.549383 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.549354 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:26:41.551161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.551019 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.551361 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.551228 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.551512 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.551462 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.551646 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.551618 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:26:41.551885 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.551850 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.552899 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.552873 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.553225 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.553189 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:26:41.553621 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.553478 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw" (OuterVolumeSpecName: "kube-api-access-9lczw") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "kube-api-access-9lczw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:26:41.553621 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.553597 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.554165 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.554134 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.554165 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.554144 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config" (OuterVolumeSpecName: "config") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.554329 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.554313 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out" (OuterVolumeSpecName: "config-out") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:26:41.555010 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.554990 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.562850 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.562827 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config" (OuterVolumeSpecName: "web-config") pod "6260c9ad-6c50-41f5-bcbe-62a2583b8146" (UID: "6260c9ad-6c50-41f5-bcbe-62a2583b8146"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:26:41.648305 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648270 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-db\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648305 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648300 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648305 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648310 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-grpc-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648319 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648329 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-kube-rbac-proxy\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648338 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648346 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648355 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648363 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lczw\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-kube-api-access-9lczw\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648373 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648381 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6260c9ad-6c50-41f5-bcbe-62a2583b8146-config-out\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648389 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-web-config\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648397 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648405 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6260c9ad-6c50-41f5-bcbe-62a2583b8146-tls-assets\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648413 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648421 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6260c9ad-6c50-41f5-bcbe-62a2583b8146-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.648535 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.648429 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6260c9ad-6c50-41f5-bcbe-62a2583b8146-secret-metrics-client-certs\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:26:41.699420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699387 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" exitCode=0 Jun 10 00:26:41.699420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699413 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" exitCode=0 Jun 10 00:26:41.699420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699419 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" exitCode=0 Jun 10 00:26:41.699420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699425 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" exitCode=0 Jun 10 00:26:41.699420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699430 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" exitCode=0 Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699435 2560 generic.go:356] "Generic (PLEG): container finished" podID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" exitCode=0 Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699491 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699582 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699619 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699668 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} Jun 10 00:26:41.699790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.699700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6260c9ad-6c50-41f5-bcbe-62a2583b8146","Type":"ContainerDied","Data":"a2a755fcb09bac46972dc18d8c1a2ffdb2d199c5aa584ca5a6bd281594d7183a"} Jun 10 00:26:41.708216 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.708197 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.715328 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.715309 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.722529 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.722512 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.723044 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.723020 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:41.729480 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.729458 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:41.729722 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.729711 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.736576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.736556 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.743774 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.743758 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.750904 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.750884 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.751177 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.751155 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.751271 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751192 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.751271 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751250 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.751512 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.751494 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.751560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751518 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.751560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751535 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.751777 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.751759 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.751818 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751781 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.751818 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.751796 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.752048 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.752031 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.752128 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752055 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.752128 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752074 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.752318 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.752300 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.752354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752326 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.752354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752347 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.752572 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.752549 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.752620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752566 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.752620 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752582 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.752829 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:26:41.752805 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.752887 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752839 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.752887 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.752859 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.753114 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753097 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.753165 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753115 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.753422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753356 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.753422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753376 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.753625 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753593 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.753625 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753616 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.753969 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753947 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.753969 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.753968 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.754313 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754287 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.754402 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754315 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.754661 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754580 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.754661 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754639 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.754950 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754931 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.755024 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.754950 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.755207 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755182 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.755280 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755207 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.755448 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755432 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.755490 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755449 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.755696 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755679 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.755737 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755696 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.755770 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755739 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:41.755898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755882 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.755939 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.755898 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.756096 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756081 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.756133 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756096 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756129 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="thanos-sidecar" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756142 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="thanos-sidecar" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756150 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756156 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756168 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-thanos" Jun 10 00:26:41.756182 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756176 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-thanos" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756189 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-web" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756198 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-web" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756213 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="init-config-reloader" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756218 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="init-config-reloader" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756230 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="prometheus" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756237 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="prometheus" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756243 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="config-reloader" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756248 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="config-reloader" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756293 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756309 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756321 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="prometheus" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756330 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-web" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756343 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="thanos-sidecar" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756349 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756355 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="kube-rbac-proxy-thanos" Jun 10 00:26:41.756419 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756361 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" containerName="config-reloader" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756474 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756490 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756680 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756693 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756882 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.756915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.756894 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.757121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757068 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.757121 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757079 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.757384 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757364 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.757427 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757384 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.757576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757562 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.757617 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757576 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.757760 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757746 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.757809 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757760 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.757951 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757930 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.758084 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.757953 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.758246 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758224 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.758348 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758248 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.758559 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758534 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.758559 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758559 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.758847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758826 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.758847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.758847 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.759104 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.759083 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.759172 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.759105 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.759615 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.759505 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.759615 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.759533 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.760145 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.760022 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.760145 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.760064 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.760645 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.760547 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.760645 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.760569 2560 scope.go:117] "RemoveContainer" containerID="1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d" Jun 10 00:26:41.761087 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761066 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d"} err="failed to get container status \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": rpc error: code = NotFound desc = could not find container \"1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d\": container with ID starting with 1e1619614e57c9b35947d351456df455180a1a48a7be486f42dfb78649b2716d not found: ID does not exist" Jun 10 00:26:41.761087 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761086 2560 scope.go:117] "RemoveContainer" containerID="fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854" Jun 10 00:26:41.761334 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761318 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854"} err="failed to get container status \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": rpc error: code = NotFound desc = could not find container \"fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854\": container with ID starting with fec91296a4399e69c245ba28b201ac0bdfc74dd15c631c5fb2df4c1839cac854 not found: ID does not exist" Jun 10 00:26:41.761334 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761334 2560 scope.go:117] "RemoveContainer" containerID="6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838" Jun 10 00:26:41.761560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761540 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838"} err="failed to get container status \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": rpc error: code = NotFound desc = could not find container \"6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838\": container with ID starting with 6f6e73a932d528ed3896d538aba01698d4273d0417157a053effd31eb1f18838 not found: ID does not exist" Jun 10 00:26:41.761560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761560 2560 scope.go:117] "RemoveContainer" containerID="5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749" Jun 10 00:26:41.761886 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761865 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749"} err="failed to get container status \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": rpc error: code = NotFound desc = could not find container \"5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749\": container with ID starting with 5b0687b4661c820f26e462e137dfe4fba75980db196e1a2bc69ad016c4376749 not found: ID does not exist" Jun 10 00:26:41.761886 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.761884 2560 scope.go:117] "RemoveContainer" containerID="ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e" Jun 10 00:26:41.762104 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.762185 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762089 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e"} err="failed to get container status \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": rpc error: code = NotFound desc = could not find container \"ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e\": container with ID starting with ee7924131d8e3d60d481fa80bd5d30e8fd052172e268b7c3a581125d7e2c001e not found: ID does not exist" Jun 10 00:26:41.762242 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762186 2560 scope.go:117] "RemoveContainer" containerID="531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319" Jun 10 00:26:41.762708 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762685 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319"} err="failed to get container status \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": rpc error: code = NotFound desc = could not find container \"531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319\": container with ID starting with 531c9068f2a4f3089ccd61bff5a4305901d40cc65fdc475a04a412d381292319 not found: ID does not exist" Jun 10 00:26:41.762708 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762708 2560 scope.go:117] "RemoveContainer" containerID="ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3" Jun 10 00:26:41.762928 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.762907 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3"} err="failed to get container status \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": rpc error: code = NotFound desc = could not find container \"ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3\": container with ID starting with ddbe72b8f099dfbb260ed8efa9bb99f69a21bf4599b12266b011a0488aecc5f3 not found: ID does not exist" Jun 10 00:26:41.764618 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764597 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 00:26:41.764736 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 00:26:41.764736 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764597 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-agh7g2t0or8qq\"" Jun 10 00:26:41.764736 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764669 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 00:26:41.764736 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764597 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 00:26:41.765089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 00:26:41.765089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.764967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 00:26:41.765089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765000 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 00:26:41.765089 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765020 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 00:26:41.765394 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765094 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 00:26:41.765394 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765222 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 00:26:41.765394 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765297 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 00:26:41.765394 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765306 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sw5kg\"" Jun 10 00:26:41.765394 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 00:26:41.765679 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.765567 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 00:26:41.767924 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.767905 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 00:26:41.770698 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.770680 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 00:26:41.777505 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.777484 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:41.849512 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849469 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849512 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849724 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtc4t\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-kube-api-access-vtc4t\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.849873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850012 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.849975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.850013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.850031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.850151 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.850049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951373 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951373 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtc4t\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-kube-api-access-vtc4t\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.951867 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.951977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952241 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.952058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952692 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.952668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.952827 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.952806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.953323 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.953295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.954572 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.954544 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.954679 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.954607 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.954679 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.954654 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.954679 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.954664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.954842 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.954709 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955254 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955229 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955365 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955365 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955555 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.955992 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.955964 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.956398 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.956378 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.956919 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.956901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.957154 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.957138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-config\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.957838 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.957818 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22101741-d36e-4522-a5c1-84807f530c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.957958 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.957941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22101741-d36e-4522-a5c1-84807f530c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:41.962129 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:41.962111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtc4t\" (UniqueName: \"kubernetes.io/projected/22101741-d36e-4522-a5c1-84807f530c9e-kube-api-access-vtc4t\") pod \"prometheus-k8s-0\" (UID: \"22101741-d36e-4522-a5c1-84807f530c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:42.072069 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.072028 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:42.214809 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.214775 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:26:42.219303 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:26:42.219247 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22101741_d36e_4522_a5c1_84807f530c9e.slice/crio-14e7e6a1097a54b5cea0b474d7cb6fd2a1c51ae8b70981bc4434a7ef057b8373 WatchSource:0}: Error finding container 14e7e6a1097a54b5cea0b474d7cb6fd2a1c51ae8b70981bc4434a7ef057b8373: Status 404 returned error can't find the container with id 14e7e6a1097a54b5cea0b474d7cb6fd2a1c51ae8b70981bc4434a7ef057b8373 Jun 10 00:26:42.444969 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.444937 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6260c9ad-6c50-41f5-bcbe-62a2583b8146" path="/var/lib/kubelet/pods/6260c9ad-6c50-41f5-bcbe-62a2583b8146/volumes" Jun 10 00:26:42.705305 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.705187 2560 generic.go:356] "Generic (PLEG): container finished" podID="22101741-d36e-4522-a5c1-84807f530c9e" containerID="6e73339cbc5bdc99de36748f46231cbbb26243b761bafc2a6052254ced88a11b" exitCode=0 Jun 10 00:26:42.705469 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.705296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerDied","Data":"6e73339cbc5bdc99de36748f46231cbbb26243b761bafc2a6052254ced88a11b"} Jun 10 00:26:42.705469 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:42.705363 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"14e7e6a1097a54b5cea0b474d7cb6fd2a1c51ae8b70981bc4434a7ef057b8373"} Jun 10 00:26:43.715372 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"3c3ac35cbb13eff5c6d58fac33e868030817ab932e57ec36b7280f92317fba3d"} Jun 10 00:26:43.715898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"c02baac8e7644539cc6ec535ce96be6d927bbe959dfb923835d822f89c1fa7d1"} Jun 10 00:26:43.715898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715435 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"523aaa8e84a659e6db8849397aae3229b03298e3865f46291a216a2cb4de21a8"} Jun 10 00:26:43.715898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"f2fcb3c8c8803310af3220092eba52125121eb0b811a3dad4574db1abe4ea5d4"} Jun 10 00:26:43.715898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"4fe70a69f067d9edaf0716ead3a627715d68b1d3308f4681fa1a8d0a38f26d13"} Jun 10 00:26:43.715898 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.715518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22101741-d36e-4522-a5c1-84807f530c9e","Type":"ContainerStarted","Data":"3a9ddac5b0a3a165aeaabe7266538a6bba327eb03e946ad39a2c929ac8495061"} Jun 10 00:26:43.743135 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:43.743059 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.722359757 podStartE2EDuration="2.7430357s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.675943ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:26:43.741111993 +0000 UTC m=+311.787655869" watchObservedRunningTime="2026-06-10 00:26:43.7430357 +0000 UTC m=+311.789579564" Jun 10 00:26:47.072328 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:47.072250 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:26:47.993047 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:26:47.993011 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:27:03.007872 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.007801 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" podUID="aef91a83-8228-403a-ad25-c2938857130f" containerName="registry" containerID="cri-o://5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30" gracePeriod=30 Jun 10 00:27:03.271206 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.271138 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:27:03.344562 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344523 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344562 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344569 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344600 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344632 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64j4t\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344695 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344718 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344740 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.344804 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.344802 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets\") pod \"aef91a83-8228-403a-ad25-c2938857130f\" (UID: \"aef91a83-8228-403a-ad25-c2938857130f\") " Jun 10 00:27:03.345143 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.345112 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:27:03.345226 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.345193 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:27:03.347593 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.347485 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:27:03.347726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.347648 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t" (OuterVolumeSpecName: "kube-api-access-64j4t") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "kube-api-access-64j4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:27:03.347726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.347656 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:27:03.347857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.347771 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:27:03.347857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.347794 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:27:03.354488 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.354449 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aef91a83-8228-403a-ad25-c2938857130f" (UID: "aef91a83-8228-403a-ad25-c2938857130f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:27:03.445664 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445629 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-installation-pull-secrets\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445664 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445660 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aef91a83-8228-403a-ad25-c2938857130f-image-registry-private-configuration\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445664 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445670 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-trusted-ca\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445679 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aef91a83-8228-403a-ad25-c2938857130f-ca-trust-extracted\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445697 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64j4t\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-kube-api-access-64j4t\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445706 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-registry-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445714 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aef91a83-8228-403a-ad25-c2938857130f-registry-certificates\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.445976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.445721 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aef91a83-8228-403a-ad25-c2938857130f-bound-sa-token\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:27:03.797615 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.797580 2560 generic.go:356] "Generic (PLEG): container finished" podID="aef91a83-8228-403a-ad25-c2938857130f" containerID="5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30" exitCode=0 Jun 10 00:27:03.797788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.797630 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" Jun 10 00:27:03.797788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.797670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" event={"ID":"aef91a83-8228-403a-ad25-c2938857130f","Type":"ContainerDied","Data":"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30"} Jun 10 00:27:03.797788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.797730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768d88cbc8-qjjd8" event={"ID":"aef91a83-8228-403a-ad25-c2938857130f","Type":"ContainerDied","Data":"5b248a5d3e48ee396843fa5431fdc2f0a5621e4459275513360d3bfcef91540d"} Jun 10 00:27:03.797788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.797758 2560 scope.go:117] "RemoveContainer" containerID="5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30" Jun 10 00:27:03.806810 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.806790 2560 scope.go:117] "RemoveContainer" containerID="5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30" Jun 10 00:27:03.807080 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:27:03.807061 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30\": container with ID starting with 5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30 not found: ID does not exist" containerID="5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30" Jun 10 00:27:03.807131 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.807090 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30"} err="failed to get container status \"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30\": rpc error: code = NotFound desc = could not find container \"5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30\": container with ID starting with 5de5d0f86da67c7330f98948cdc9e34e13c222758f0b28d73e53e3205514be30 not found: ID does not exist" Jun 10 00:27:03.818559 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.818533 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:27:03.821683 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:03.821661 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-768d88cbc8-qjjd8"] Jun 10 00:27:04.444995 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:04.444959 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef91a83-8228-403a-ad25-c2938857130f" path="/var/lib/kubelet/pods/aef91a83-8228-403a-ad25-c2938857130f/volumes" Jun 10 00:27:42.072908 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:42.072862 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:27:42.088588 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:42.088550 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:27:42.966894 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:27:42.966859 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:28:43.006324 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.006286 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-24p2b"] Jun 10 00:28:43.006788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.006597 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef91a83-8228-403a-ad25-c2938857130f" containerName="registry" Jun 10 00:28:43.006788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.006607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef91a83-8228-403a-ad25-c2938857130f" containerName="registry" Jun 10 00:28:43.006788 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.006662 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef91a83-8228-403a-ad25-c2938857130f" containerName="registry" Jun 10 00:28:43.009544 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.009526 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.011919 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.011887 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 00:28:43.011919 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.011914 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hm2wr\"" Jun 10 00:28:43.012849 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.012831 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 00:28:43.018675 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.018651 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-24p2b"] Jun 10 00:28:43.089337 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.089294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.089518 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.089377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq4f\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-kube-api-access-stq4f\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.190523 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.190489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.190691 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.190534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stq4f\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-kube-api-access-stq4f\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.198045 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.198014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.198196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.198083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq4f\" (UniqueName: \"kubernetes.io/projected/12432042-fbdf-41bc-a2fc-a6b1cb8924e1-kube-api-access-stq4f\") pod \"cert-manager-cainjector-5d99449ffd-24p2b\" (UID: \"12432042-fbdf-41bc-a2fc-a6b1cb8924e1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.328707 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.328670 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" Jun 10 00:28:43.456444 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.456408 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-24p2b"] Jun 10 00:28:43.459397 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:28:43.459366 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12432042_fbdf_41bc_a2fc_a6b1cb8924e1.slice/crio-aee7df72dfc6f077c079f6dac3fbacd9590aa10e57d015125d3a766876f4b6ca WatchSource:0}: Error finding container aee7df72dfc6f077c079f6dac3fbacd9590aa10e57d015125d3a766876f4b6ca: Status 404 returned error can't find the container with id aee7df72dfc6f077c079f6dac3fbacd9590aa10e57d015125d3a766876f4b6ca Jun 10 00:28:43.461277 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:43.461245 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:28:44.195993 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:44.195938 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" event={"ID":"12432042-fbdf-41bc-a2fc-a6b1cb8924e1","Type":"ContainerStarted","Data":"aee7df72dfc6f077c079f6dac3fbacd9590aa10e57d015125d3a766876f4b6ca"} Jun 10 00:28:47.211191 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:47.211152 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" event={"ID":"12432042-fbdf-41bc-a2fc-a6b1cb8924e1","Type":"ContainerStarted","Data":"2ae51e9bb419aa3278d3c0dcd73b6d07a799194fab4dbfd8782744f150832134"} Jun 10 00:28:47.226947 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:28:47.226895 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-24p2b" podStartSLOduration=2.203429023 podStartE2EDuration="5.22688104s" totalImagesPullingTime="3.023452017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:28:47.225562538 +0000 UTC m=+435.272106404" watchObservedRunningTime="2026-06-10 00:28:47.22688104 +0000 UTC m=+435.273424902" Jun 10 00:29:16.217635 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.217602 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j"] Jun 10 00:29:16.220913 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.220895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.224537 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.224513 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 00:29:16.225612 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.225592 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 00:29:16.225612 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.225602 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:29:16.225783 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.225672 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bdzjs\"" Jun 10 00:29:16.225783 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.225713 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 00:29:16.225922 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.225906 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 00:29:16.236307 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.236285 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j"] Jun 10 00:29:16.266168 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.266135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrg2s\" (UniqueName: \"kubernetes.io/projected/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-kube-api-access-xrg2s\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.266367 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.266174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-metrics-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.266367 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.266302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.266367 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.266333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-manager-config\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.367713 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.367668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.367915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.367732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-manager-config\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.367915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.367781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrg2s\" (UniqueName: \"kubernetes.io/projected/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-kube-api-access-xrg2s\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.367915 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.367813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-metrics-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.368532 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.368505 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-manager-config\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.370316 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.370292 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.370403 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.370326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-metrics-cert\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.379636 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.379613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrg2s\" (UniqueName: \"kubernetes.io/projected/131c9b17-38a8-4c17-9c12-3c03ce89aa4f-kube-api-access-xrg2s\") pod \"lws-controller-manager-5cf5b49598-gn62j\" (UID: \"131c9b17-38a8-4c17-9c12-3c03ce89aa4f\") " pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.531019 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.530914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:16.665348 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:16.665322 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j"] Jun 10 00:29:16.667952 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:29:16.667922 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131c9b17_38a8_4c17_9c12_3c03ce89aa4f.slice/crio-4e4ab0946fb9871074a866aa60db1c2ced714eeeab6da02d55dbc298a2cdc889 WatchSource:0}: Error finding container 4e4ab0946fb9871074a866aa60db1c2ced714eeeab6da02d55dbc298a2cdc889: Status 404 returned error can't find the container with id 4e4ab0946fb9871074a866aa60db1c2ced714eeeab6da02d55dbc298a2cdc889 Jun 10 00:29:17.332560 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.332512 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" event={"ID":"131c9b17-38a8-4c17-9c12-3c03ce89aa4f","Type":"ContainerStarted","Data":"4e4ab0946fb9871074a866aa60db1c2ced714eeeab6da02d55dbc298a2cdc889"} Jun 10 00:29:17.395378 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.395332 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc"] Jun 10 00:29:17.399053 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.399025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.404279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.404238 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 00:29:17.404428 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.404401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kzrn6\"" Jun 10 00:29:17.404495 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.404441 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 00:29:17.404495 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.404453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 00:29:17.404602 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.404557 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 00:29:17.428856 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.428808 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc"] Jun 10 00:29:17.479422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.479385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.479422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.479424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.479661 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.479509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.479661 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.479566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbb9\" (UniqueName: \"kubernetes.io/projected/144abd22-c58c-4a94-8888-626c473b6469-kube-api-access-mtbb9\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.479661 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.479599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.580137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.580137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.580410 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.580410 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbb9\" (UniqueName: \"kubernetes.io/projected/144abd22-c58c-4a94-8888-626c473b6469-kube-api-access-mtbb9\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.580410 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.581063 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.580786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.583872 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.583770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/144abd22-c58c-4a94-8888-626c473b6469-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.583872 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.583790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.585013 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.584988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/144abd22-c58c-4a94-8888-626c473b6469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.592684 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.592652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbb9\" (UniqueName: \"kubernetes.io/projected/144abd22-c58c-4a94-8888-626c473b6469-kube-api-access-mtbb9\") pod \"opendatahub-operator-controller-manager-7b7d59c946-hx8cc\" (UID: \"144abd22-c58c-4a94-8888-626c473b6469\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.714291 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.714235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:17.886230 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:17.886145 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc"] Jun 10 00:29:17.889965 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:29:17.889933 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144abd22_c58c_4a94_8888_626c473b6469.slice/crio-068de0254de35142cff9414b4090b0de4f26484def67596eff016d90f2a60076 WatchSource:0}: Error finding container 068de0254de35142cff9414b4090b0de4f26484def67596eff016d90f2a60076: Status 404 returned error can't find the container with id 068de0254de35142cff9414b4090b0de4f26484def67596eff016d90f2a60076 Jun 10 00:29:18.340337 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:18.340296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" event={"ID":"144abd22-c58c-4a94-8888-626c473b6469","Type":"ContainerStarted","Data":"068de0254de35142cff9414b4090b0de4f26484def67596eff016d90f2a60076"} Jun 10 00:29:19.348604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:19.348509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" event={"ID":"131c9b17-38a8-4c17-9c12-3c03ce89aa4f","Type":"ContainerStarted","Data":"92bcc302eddc364906c6e6ff709f7527225553da005da8f8a72e9ec1411fc57c"} Jun 10 00:29:19.349065 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:19.348778 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:19.367231 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:19.367174 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" podStartSLOduration=0.938486579 podStartE2EDuration="3.367155658s" totalImagesPullingTime="2.428669079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:19.365211172 +0000 UTC m=+467.411755065" watchObservedRunningTime="2026-06-10 00:29:19.367155658 +0000 UTC m=+467.413699523" Jun 10 00:29:22.363864 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:22.363825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" event={"ID":"144abd22-c58c-4a94-8888-626c473b6469","Type":"ContainerStarted","Data":"0fb542bf531009f2f126b08b31c3295a3481115b1063e4f4bc9d61e9d580d442"} Jun 10 00:29:23.369496 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:23.369460 2560 generic.go:356] "Generic (PLEG): container finished" podID="144abd22-c58c-4a94-8888-626c473b6469" containerID="0fb542bf531009f2f126b08b31c3295a3481115b1063e4f4bc9d61e9d580d442" exitCode=0 Jun 10 00:29:23.369896 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:23.369529 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" event={"ID":"144abd22-c58c-4a94-8888-626c473b6469","Type":"ContainerDied","Data":"0fb542bf531009f2f126b08b31c3295a3481115b1063e4f4bc9d61e9d580d442"} Jun 10 00:29:24.375504 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:24.375470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" event={"ID":"144abd22-c58c-4a94-8888-626c473b6469","Type":"ContainerStarted","Data":"3bbc92b7f0ec86428e4405e666c9622ed71f15b48ec786191c9660770d155517"} Jun 10 00:29:24.375891 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:24.375561 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:24.396469 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:24.396418 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" podStartSLOduration=2.232018145 podStartE2EDuration="7.396401437s" totalImagesPullingTime="4.089018967s" totalInitContainerRuntime="1.075364325s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:24.394958433 +0000 UTC m=+472.441502320" watchObservedRunningTime="2026-06-10 00:29:24.396401437 +0000 UTC m=+472.442945300" Jun 10 00:29:30.355703 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:30.355667 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf5b49598-gn62j" Jun 10 00:29:35.382576 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:35.382543 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-hx8cc" Jun 10 00:29:37.478068 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.478026 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9"] Jun 10 00:29:37.487225 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.487201 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.490029 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.490006 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 00:29:37.490162 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.490091 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 00:29:37.491009 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.490990 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gfdh2\"" Jun 10 00:29:37.491109 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.491009 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 00:29:37.491109 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.491026 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 00:29:37.497330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.497306 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9"] Jun 10 00:29:37.562330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.562290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tmp\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.562510 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.562363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.562510 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.562388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhltc\" (UniqueName: \"kubernetes.io/projected/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-kube-api-access-hhltc\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.663604 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.663570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.663764 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.663609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhltc\" (UniqueName: \"kubernetes.io/projected/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-kube-api-access-hhltc\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.663764 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.663653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tmp\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.663845 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:29:37.663756 2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 00:29:37.663845 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:29:37.663841 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs podName:96ed330d-ddb7-4af2-b1e1-f713df77b1b9 nodeName:}" failed. No retries permitted until 2026-06-10 00:29:38.163818693 +0000 UTC m=+486.210362554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs") pod "kube-auth-proxy-7c998fc6cc-w2br9" (UID: "96ed330d-ddb7-4af2-b1e1-f713df77b1b9") : secret "kube-auth-proxy-tls" not found Jun 10 00:29:37.666008 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.665973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tmp\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:37.674633 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:37.674603 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhltc\" (UniqueName: \"kubernetes.io/projected/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-kube-api-access-hhltc\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:38.167974 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:38.167931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:38.170547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:38.170523 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ed330d-ddb7-4af2-b1e1-f713df77b1b9-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-w2br9\" (UID: \"96ed330d-ddb7-4af2-b1e1-f713df77b1b9\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:38.398468 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:38.398432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" Jun 10 00:29:38.536574 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:38.536546 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9"] Jun 10 00:29:38.539109 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:29:38.539071 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ed330d_ddb7_4af2_b1e1_f713df77b1b9.slice/crio-de978c2d104ed1917a8b4468ec5456911a0331dc1690499b1fa5fe0c5f96eb9c WatchSource:0}: Error finding container de978c2d104ed1917a8b4468ec5456911a0331dc1690499b1fa5fe0c5f96eb9c: Status 404 returned error can't find the container with id de978c2d104ed1917a8b4468ec5456911a0331dc1690499b1fa5fe0c5f96eb9c Jun 10 00:29:39.443578 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:39.443533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" event={"ID":"96ed330d-ddb7-4af2-b1e1-f713df77b1b9","Type":"ContainerStarted","Data":"de978c2d104ed1917a8b4468ec5456911a0331dc1690499b1fa5fe0c5f96eb9c"} Jun 10 00:29:42.458926 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:42.458887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" event={"ID":"96ed330d-ddb7-4af2-b1e1-f713df77b1b9","Type":"ContainerStarted","Data":"ed080802a531292f3701fe34d4adaf4a31b351eb2294f8848d40f7fdde14ce49"} Jun 10 00:29:42.474759 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:29:42.474708 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-w2br9" podStartSLOduration=2.340700783 podStartE2EDuration="5.474692823s" totalImagesPullingTime="3.13399204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:42.473206081 +0000 UTC m=+490.519749945" watchObservedRunningTime="2026-06-10 00:29:42.474692823 +0000 UTC m=+490.521236733" Jun 10 00:31:18.321080 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.321039 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4"] Jun 10 00:31:18.323467 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.323444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.325796 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.325774 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 00:31:18.325912 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.325829 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 00:31:18.325912 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.325864 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r5hs8\"" Jun 10 00:31:18.334297 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.334276 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4"] Jun 10 00:31:18.445998 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.445955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.446196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.446092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppv29\" (UniqueName: \"kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.547225 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.547181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.547460 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.547279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppv29\" (UniqueName: \"kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.547671 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.547646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.561496 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.561462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppv29\" (UniqueName: \"kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.634054 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.633945 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:18.794060 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.793866 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4"] Jun 10 00:31:18.797183 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:31:18.797144 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a768cc_3ce5_4f1d_b63a_7ee625c169cc.slice/crio-a0cb9844f8e99b984aff3593b4fd3af116956a6d8cf0de978677d02acb6a87fa WatchSource:0}: Error finding container a0cb9844f8e99b984aff3593b4fd3af116956a6d8cf0de978677d02acb6a87fa: Status 404 returned error can't find the container with id a0cb9844f8e99b984aff3593b4fd3af116956a6d8cf0de978677d02acb6a87fa Jun 10 00:31:18.877905 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:18.877867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" event={"ID":"72a768cc-3ce5-4f1d-b63a-7ee625c169cc","Type":"ContainerStarted","Data":"a0cb9844f8e99b984aff3593b4fd3af116956a6d8cf0de978677d02acb6a87fa"} Jun 10 00:31:28.923425 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:28.923386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" event={"ID":"72a768cc-3ce5-4f1d-b63a-7ee625c169cc","Type":"ContainerStarted","Data":"925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88"} Jun 10 00:31:28.923789 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:28.923571 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:28.943530 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:28.943474 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" podStartSLOduration=1.405200657 podStartE2EDuration="10.943459338s" totalImagesPullingTime="9.538258681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:31:28.941648576 +0000 UTC m=+596.988192451" watchObservedRunningTime="2026-06-10 00:31:28.943459338 +0000 UTC m=+596.990003201" Jun 10 00:31:32.409832 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:32.409804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:31:32.410280 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:32.409864 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:31:32.417439 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:32.417419 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:31:32.417571 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:32.417480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:31:39.930427 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:39.930395 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:40.827909 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.827875 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx"] Jun 10 00:31:40.830268 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.830239 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.850601 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.850569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc64h\" (UniqueName: \"kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.850754 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.850632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.853255 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.853228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx"] Jun 10 00:31:40.951926 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.951881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc64h\" (UniqueName: \"kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.951926 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.951936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.952410 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.952318 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:40.962500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:40.962477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc64h\" (UniqueName: \"kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:41.140647 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.140552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:41.273508 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.273417 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx"] Jun 10 00:31:41.276927 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:31:41.276896 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dda9637_9aa5_42db_9b52_a28ee4a02e06.slice/crio-8dcfab4d01112990c4775b0c3debb2c94420549bf3b8e883e4fc310ec7e42f75 WatchSource:0}: Error finding container 8dcfab4d01112990c4775b0c3debb2c94420549bf3b8e883e4fc310ec7e42f75: Status 404 returned error can't find the container with id 8dcfab4d01112990c4775b0c3debb2c94420549bf3b8e883e4fc310ec7e42f75 Jun 10 00:31:41.499904 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.499818 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx"] Jun 10 00:31:41.508819 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.508787 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx"] Jun 10 00:31:41.523534 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.523499 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4"] Jun 10 00:31:41.523798 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.523747 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" containerName="manager" containerID="cri-o://925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88" gracePeriod=2 Jun 10 00:31:41.528292 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.528237 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:31:41.528708 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.528687 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" containerName="manager" Jun 10 00:31:41.528708 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.528709 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" containerName="manager" Jun 10 00:31:41.528866 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.528808 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" containerName="manager" Jun 10 00:31:41.531298 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.531275 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.535196 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.535174 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4"] Jun 10 00:31:41.541349 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.541318 2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-trts4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.543859 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.543400 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.544413 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.544389 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:41.544866 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.544845 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" containerName="manager" Jun 10 00:31:41.544866 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.544866 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" containerName="manager" Jun 10 00:31:41.545016 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.544962 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" containerName="manager" Jun 10 00:31:41.548290 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.548242 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:31:41.548379 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.548340 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.557332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.557306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.557462 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.557401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbkf\" (UniqueName: \"kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.567074 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.567045 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:41.570434 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.570403 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.658688 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.658653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbkf\" (UniqueName: \"kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.658850 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.658731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.658850 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.658822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.658935 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.658890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5mzm\" (UniqueName: \"kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.659192 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.659175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.676845 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.676816 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbkf\" (UniqueName: \"kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ftfzp\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.747802 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.747778 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.750609 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.750557 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.759965 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.759940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.760069 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.759994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5mzm\" (UniqueName: \"kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.760373 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.760351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.770311 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.770285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5mzm\" (UniqueName: \"kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nv8gh\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.860766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.860716 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppv29\" (UniqueName: \"kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29\") pod \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " Jun 10 00:31:41.860766 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.860756 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume\") pod \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\" (UID: \"72a768cc-3ce5-4f1d-b63a-7ee625c169cc\") " Jun 10 00:31:41.861160 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.861130 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72a768cc-3ce5-4f1d-b63a-7ee625c169cc" (UID: "72a768cc-3ce5-4f1d-b63a-7ee625c169cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:31:41.863172 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.863147 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29" (OuterVolumeSpecName: "kube-api-access-ppv29") pod "72a768cc-3ce5-4f1d-b63a-7ee625c169cc" (UID: "72a768cc-3ce5-4f1d-b63a-7ee625c169cc"). InnerVolumeSpecName "kube-api-access-ppv29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:31:41.886870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.886828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:41.905833 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.905785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:41.962857 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.962821 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppv29\" (UniqueName: \"kubernetes.io/projected/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-kube-api-access-ppv29\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:41.963247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.962860 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a768cc-3ce5-4f1d-b63a-7ee625c169cc-extensions-socket-volume\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:41.985728 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.985693 2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" container="manager" Jun 10 00:31:41.987445 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.987395 2560 generic.go:356] "Generic (PLEG): container finished" podID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" containerID="925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88" exitCode=0 Jun 10 00:31:41.987638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.987448 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.987638 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.987530 2560 scope.go:117] "RemoveContainer" containerID="925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88" Jun 10 00:31:41.988054 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.988021 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.992413 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.992193 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:41.994149 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.994011 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:41.995765 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.995711 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:41.999148 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.999093 2560 scope.go:117] "RemoveContainer" containerID="925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88" Jun 10 00:31:42.000166 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:41.999572 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88\": container with ID starting with 925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88 not found: ID does not exist" containerID="925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88" Jun 10 00:31:42.000166 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:41.999612 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88"} err="failed to get container status \"925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88\": rpc error: code = NotFound desc = could not find container \"925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88\": container with ID starting with 925b5f774525b8ffcc21a5e5ef31ba4240e87b33291f8173ecac5e013570da88 not found: ID does not exist" Jun 10 00:31:42.004821 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:42.004653 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:42.006553 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:42.006523 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:42.048627 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.048600 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:31:42.051415 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:31:42.051385 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e15958_7e23_4b35_a8a1_7e742cfe080e.slice/crio-dc930d104d5c10487df6c5cfa2b5f6ab545750fbbd970acb8768f4274510252e WatchSource:0}: Error finding container dc930d104d5c10487df6c5cfa2b5f6ab545750fbbd970acb8768f4274510252e: Status 404 returned error can't find the container with id dc930d104d5c10487df6c5cfa2b5f6ab545750fbbd970acb8768f4274510252e Jun 10 00:31:42.062632 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.062602 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:42.067382 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:31:42.067353 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d9d21c_b00e_4862_ad75_0883f464a82d.slice/crio-6068d6264733de6cc98e7ef06086b7b471ce4c44d8fd1aa21bdbb96d4fa59bdc WatchSource:0}: Error finding container 6068d6264733de6cc98e7ef06086b7b471ce4c44d8fd1aa21bdbb96d4fa59bdc: Status 404 returned error can't find the container with id 6068d6264733de6cc98e7ef06086b7b471ce4c44d8fd1aa21bdbb96d4fa59bdc Jun 10 00:31:42.446707 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.446672 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" path="/var/lib/kubelet/pods/72a768cc-3ce5-4f1d-b63a-7ee625c169cc/volumes" Jun 10 00:31:42.448218 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:42.448193 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trts4\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="72a768cc-3ce5-4f1d-b63a-7ee625c169cc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trts4" Jun 10 00:31:42.454188 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:42.454164 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:42.995447 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.995409 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" containerName="manager" containerID="cri-o://091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf" gracePeriod=2 Jun 10 00:31:42.997145 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.997114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" event={"ID":"68d9d21c-b00e-4862-ad75-0883f464a82d","Type":"ContainerStarted","Data":"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b"} Jun 10 00:31:42.997285 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.997166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" event={"ID":"68d9d21c-b00e-4862-ad75-0883f464a82d","Type":"ContainerStarted","Data":"6068d6264733de6cc98e7ef06086b7b471ce4c44d8fd1aa21bdbb96d4fa59bdc"} Jun 10 00:31:42.997285 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:42.997204 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:43.003087 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.003062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" event={"ID":"f2e15958-7e23-4b35-a8a1-7e742cfe080e","Type":"ContainerStarted","Data":"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e"} Jun 10 00:31:43.003178 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.003114 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:43.003178 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.003142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" event={"ID":"f2e15958-7e23-4b35-a8a1-7e742cfe080e","Type":"ContainerStarted","Data":"dc930d104d5c10487df6c5cfa2b5f6ab545750fbbd970acb8768f4274510252e"} Jun 10 00:31:43.022552 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.022503 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" podStartSLOduration=2.022486086 podStartE2EDuration="2.022486086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:31:43.020085169 +0000 UTC m=+611.066629033" watchObservedRunningTime="2026-06-10 00:31:43.022486086 +0000 UTC m=+611.069029948" Jun 10 00:31:43.038148 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.038027 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" podStartSLOduration=2.038008843 podStartE2EDuration="2.038008843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:31:43.0373616 +0000 UTC m=+611.083905464" watchObservedRunningTime="2026-06-10 00:31:43.038008843 +0000 UTC m=+611.084552704" Jun 10 00:31:43.231364 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.231334 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:43.233559 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:43.233529 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:43.276142 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.276048 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc64h\" (UniqueName: \"kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h\") pod \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " Jun 10 00:31:43.276142 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.276120 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume\") pod \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\" (UID: \"2dda9637-9aa5-42db-9b52-a28ee4a02e06\") " Jun 10 00:31:43.276412 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.276382 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2dda9637-9aa5-42db-9b52-a28ee4a02e06" (UID: "2dda9637-9aa5-42db-9b52-a28ee4a02e06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:31:43.278129 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.278105 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h" (OuterVolumeSpecName: "kube-api-access-wc64h") pod "2dda9637-9aa5-42db-9b52-a28ee4a02e06" (UID: "2dda9637-9aa5-42db-9b52-a28ee4a02e06"). InnerVolumeSpecName "kube-api-access-wc64h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:31:43.377168 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.377131 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc64h\" (UniqueName: \"kubernetes.io/projected/2dda9637-9aa5-42db-9b52-a28ee4a02e06-kube-api-access-wc64h\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:43.377168 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:43.377160 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dda9637-9aa5-42db-9b52-a28ee4a02e06-extensions-socket-volume\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:44.008916 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.008877 2560 generic.go:356] "Generic (PLEG): container finished" podID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" containerID="091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf" exitCode=2 Jun 10 00:31:44.009353 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.008925 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:44.009353 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.008976 2560 scope.go:117] "RemoveContainer" containerID="091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf" Jun 10 00:31:44.011194 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:44.011165 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:44.017683 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.017664 2560 scope.go:117] "RemoveContainer" containerID="091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf" Jun 10 00:31:44.017967 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:44.017947 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf\": container with ID starting with 091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf not found: ID does not exist" containerID="091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf" Jun 10 00:31:44.018008 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.017978 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf"} err="failed to get container status \"091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf\": rpc error: code = NotFound desc = could not find container \"091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf\": container with ID starting with 091f62e49a09d4f9e08567280782ea24e526bd552b62095f3d75aaf7e3374bcf not found: ID does not exist" Jun 10 00:31:44.019518 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:44.019494 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rlcx\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rlcx" Jun 10 00:31:44.446292 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:44.446244 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dda9637-9aa5-42db-9b52-a28ee4a02e06" path="/var/lib/kubelet/pods/2dda9637-9aa5-42db-9b52-a28ee4a02e06/volumes" Jun 10 00:31:54.012223 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.012147 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:31:54.012223 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.012220 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:54.079360 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.079327 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:54.079588 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.079526 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" podUID="68d9d21c-b00e-4862-ad75-0883f464a82d" containerName="manager" containerID="cri-o://2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b" gracePeriod=10 Jun 10 00:31:54.327601 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.327575 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:54.330934 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.330907 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc"] Jun 10 00:31:54.331237 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.331225 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d9d21c-b00e-4862-ad75-0883f464a82d" containerName="manager" Jun 10 00:31:54.331299 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.331238 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d9d21c-b00e-4862-ad75-0883f464a82d" containerName="manager" Jun 10 00:31:54.331342 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.331332 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d9d21c-b00e-4862-ad75-0883f464a82d" containerName="manager" Jun 10 00:31:54.333084 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.333068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.350129 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.350093 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc"] Jun 10 00:31:54.487590 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.487554 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume\") pod \"68d9d21c-b00e-4862-ad75-0883f464a82d\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " Jun 10 00:31:54.487782 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.487618 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5mzm\" (UniqueName: \"kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm\") pod \"68d9d21c-b00e-4862-ad75-0883f464a82d\" (UID: \"68d9d21c-b00e-4862-ad75-0883f464a82d\") " Jun 10 00:31:54.487782 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.487768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d24087e1-b48d-4aee-a446-1879ae9b47fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.487963 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.487938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqmk\" (UniqueName: \"kubernetes.io/projected/d24087e1-b48d-4aee-a446-1879ae9b47fd-kube-api-access-szqmk\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.488025 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.487986 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68d9d21c-b00e-4862-ad75-0883f464a82d" (UID: "68d9d21c-b00e-4862-ad75-0883f464a82d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:31:54.489910 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.489874 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm" (OuterVolumeSpecName: "kube-api-access-x5mzm") pod "68d9d21c-b00e-4862-ad75-0883f464a82d" (UID: "68d9d21c-b00e-4862-ad75-0883f464a82d"). InnerVolumeSpecName "kube-api-access-x5mzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:31:54.589426 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.589386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqmk\" (UniqueName: \"kubernetes.io/projected/d24087e1-b48d-4aee-a446-1879ae9b47fd-kube-api-access-szqmk\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.589629 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.589468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d24087e1-b48d-4aee-a446-1879ae9b47fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.589629 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.589592 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d9d21c-b00e-4862-ad75-0883f464a82d-extensions-socket-volume\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:54.589629 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.589608 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5mzm\" (UniqueName: \"kubernetes.io/projected/68d9d21c-b00e-4862-ad75-0883f464a82d-kube-api-access-x5mzm\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:31:54.589985 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.589959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d24087e1-b48d-4aee-a446-1879ae9b47fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.607229 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.607197 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqmk\" (UniqueName: \"kubernetes.io/projected/d24087e1-b48d-4aee-a446-1879ae9b47fd-kube-api-access-szqmk\") pod \"kuadrant-operator-controller-manager-86878c769f-b7mvc\" (UID: \"d24087e1-b48d-4aee-a446-1879ae9b47fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.642831 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.642794 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:54.776520 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:54.776453 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc"] Jun 10 00:31:54.779471 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:31:54.779445 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24087e1_b48d_4aee_a446_1879ae9b47fd.slice/crio-c5b18fb9e2799b386fe9260f48f89556742b74eadca8297e3193f9070b8cd10b WatchSource:0}: Error finding container c5b18fb9e2799b386fe9260f48f89556742b74eadca8297e3193f9070b8cd10b: Status 404 returned error can't find the container with id c5b18fb9e2799b386fe9260f48f89556742b74eadca8297e3193f9070b8cd10b Jun 10 00:31:55.061795 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.061758 2560 generic.go:356] "Generic (PLEG): container finished" podID="68d9d21c-b00e-4862-ad75-0883f464a82d" containerID="2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b" exitCode=0 Jun 10 00:31:55.062242 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.061804 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" Jun 10 00:31:55.062242 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.061845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" event={"ID":"68d9d21c-b00e-4862-ad75-0883f464a82d","Type":"ContainerDied","Data":"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b"} Jun 10 00:31:55.062242 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.061913 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh" event={"ID":"68d9d21c-b00e-4862-ad75-0883f464a82d","Type":"ContainerDied","Data":"6068d6264733de6cc98e7ef06086b7b471ce4c44d8fd1aa21bdbb96d4fa59bdc"} Jun 10 00:31:55.062242 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.061945 2560 scope.go:117] "RemoveContainer" containerID="2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b" Jun 10 00:31:55.063703 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.063677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" event={"ID":"d24087e1-b48d-4aee-a446-1879ae9b47fd","Type":"ContainerStarted","Data":"8669a0f50755dccf492bd28221986c36809b1ab5afa93248b06fc97f079944c3"} Jun 10 00:31:55.063847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.063725 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:31:55.063847 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.063742 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" event={"ID":"d24087e1-b48d-4aee-a446-1879ae9b47fd","Type":"ContainerStarted","Data":"c5b18fb9e2799b386fe9260f48f89556742b74eadca8297e3193f9070b8cd10b"} Jun 10 00:31:55.071297 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.071251 2560 scope.go:117] "RemoveContainer" containerID="2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b" Jun 10 00:31:55.071582 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:31:55.071564 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b\": container with ID starting with 2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b not found: ID does not exist" containerID="2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b" Jun 10 00:31:55.071634 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.071594 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b"} err="failed to get container status \"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b\": rpc error: code = NotFound desc = could not find container \"2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b\": container with ID starting with 2079d314d7cabaa204b49333855054c0e20a4cbc979d11db80df71906a650e2b not found: ID does not exist" Jun 10 00:31:55.089769 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.089703 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" podStartSLOduration=1.089684454 podStartE2EDuration="1.089684454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:31:55.086886745 +0000 UTC m=+623.133430638" watchObservedRunningTime="2026-06-10 00:31:55.089684454 +0000 UTC m=+623.136228318" Jun 10 00:31:55.100308 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.100246 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:55.104866 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:55.104837 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nv8gh"] Jun 10 00:31:56.450188 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:31:56.450143 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d9d21c-b00e-4862-ad75-0883f464a82d" path="/var/lib/kubelet/pods/68d9d21c-b00e-4862-ad75-0883f464a82d/volumes" Jun 10 00:32:06.071417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.071384 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b7mvc" Jun 10 00:32:06.121066 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.121034 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:32:06.121895 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.121829 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" podUID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" containerName="manager" containerID="cri-o://bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e" gracePeriod=10 Jun 10 00:32:06.368293 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.368253 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:32:06.496230 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.496192 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume\") pod \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " Jun 10 00:32:06.496422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.496299 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqbkf\" (UniqueName: \"kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf\") pod \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\" (UID: \"f2e15958-7e23-4b35-a8a1-7e742cfe080e\") " Jun 10 00:32:06.496671 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.496644 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2e15958-7e23-4b35-a8a1-7e742cfe080e" (UID: "f2e15958-7e23-4b35-a8a1-7e742cfe080e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:32:06.498376 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.498354 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf" (OuterVolumeSpecName: "kube-api-access-zqbkf") pod "f2e15958-7e23-4b35-a8a1-7e742cfe080e" (UID: "f2e15958-7e23-4b35-a8a1-7e742cfe080e"). InnerVolumeSpecName "kube-api-access-zqbkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:32:06.597403 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.597364 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqbkf\" (UniqueName: \"kubernetes.io/projected/f2e15958-7e23-4b35-a8a1-7e742cfe080e-kube-api-access-zqbkf\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:32:06.597403 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:06.597396 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2e15958-7e23-4b35-a8a1-7e742cfe080e-extensions-socket-volume\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:32:07.131062 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.131009 2560 generic.go:356] "Generic (PLEG): container finished" podID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" containerID="bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e" exitCode=0 Jun 10 00:32:07.131062 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.131054 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" Jun 10 00:32:07.131681 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.131086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" event={"ID":"f2e15958-7e23-4b35-a8a1-7e742cfe080e","Type":"ContainerDied","Data":"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e"} Jun 10 00:32:07.131681 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.131145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp" event={"ID":"f2e15958-7e23-4b35-a8a1-7e742cfe080e","Type":"ContainerDied","Data":"dc930d104d5c10487df6c5cfa2b5f6ab545750fbbd970acb8768f4274510252e"} Jun 10 00:32:07.131681 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.131177 2560 scope.go:117] "RemoveContainer" containerID="bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e" Jun 10 00:32:07.141217 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.141198 2560 scope.go:117] "RemoveContainer" containerID="bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e" Jun 10 00:32:07.141532 ip-10-0-130-91 kubenswrapper[2560]: E0610 00:32:07.141512 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e\": container with ID starting with bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e not found: ID does not exist" containerID="bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e" Jun 10 00:32:07.141595 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.141542 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e"} err="failed to get container status \"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e\": rpc error: code = NotFound desc = could not find container \"bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e\": container with ID starting with bd28af4d3aa685fa0bb869b90c5a7bd6456d3d667bc58e86beb1cb6eafff604e not found: ID does not exist" Jun 10 00:32:07.162502 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.162470 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:32:07.166544 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:07.166516 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ftfzp"] Jun 10 00:32:08.446086 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:08.446051 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" path="/var/lib/kubelet/pods/f2e15958-7e23-4b35-a8a1-7e742cfe080e/volumes" Jun 10 00:32:26.233189 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.233153 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:32:26.233632 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.233537 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" containerName="manager" Jun 10 00:32:26.233632 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.233553 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" containerName="manager" Jun 10 00:32:26.233632 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.233609 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e15958-7e23-4b35-a8a1-7e742cfe080e" containerName="manager" Jun 10 00:32:26.235646 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.235627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.238067 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.238042 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nm97h\"" Jun 10 00:32:26.238172 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.238078 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 00:32:26.243785 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.243759 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:32:26.271174 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.271135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-config-file\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.271378 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.271194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j79vl\" (UniqueName: \"kubernetes.io/projected/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-kube-api-access-j79vl\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.275123 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.275086 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:32:26.372287 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.372223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-config-file\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.372472 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.372324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j79vl\" (UniqueName: \"kubernetes.io/projected/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-kube-api-access-j79vl\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.372877 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.372859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-config-file\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.381612 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.381577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j79vl\" (UniqueName: \"kubernetes.io/projected/d19ef9e9-3ae5-4c95-8b01-8d158dc760fa-kube-api-access-j79vl\") pod \"limitador-limitador-54d6d988d5-t8xrh\" (UID: \"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.546485 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.546443 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:26.683886 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:26.683857 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:32:26.686713 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:32:26.686661 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19ef9e9_3ae5_4c95_8b01_8d158dc760fa.slice/crio-880ea1c931c3faaecfd7f59efb7b48d9290054ca543b86833a5a584df73f6e23 WatchSource:0}: Error finding container 880ea1c931c3faaecfd7f59efb7b48d9290054ca543b86833a5a584df73f6e23: Status 404 returned error can't find the container with id 880ea1c931c3faaecfd7f59efb7b48d9290054ca543b86833a5a584df73f6e23 Jun 10 00:32:27.234392 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:27.234298 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" event={"ID":"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa","Type":"ContainerStarted","Data":"880ea1c931c3faaecfd7f59efb7b48d9290054ca543b86833a5a584df73f6e23"} Jun 10 00:32:29.245330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:29.245285 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" event={"ID":"d19ef9e9-3ae5-4c95-8b01-8d158dc760fa","Type":"ContainerStarted","Data":"ff325fa36a85aa3ce6589aab440d27b9495be56bd3ac63185e07533b0b76a88e"} Jun 10 00:32:29.245703 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:29.245459 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:32:29.262026 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:29.261971 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" podStartSLOduration=0.815319338 podStartE2EDuration="3.261954831s" totalImagesPullingTime="2.446635493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:32:29.260536475 +0000 UTC m=+657.307080350" watchObservedRunningTime="2026-06-10 00:32:29.261954831 +0000 UTC m=+657.308498694" Jun 10 00:32:40.251141 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:32:40.251099 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t8xrh" Jun 10 00:34:02.394705 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.394663 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:34:02.397133 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.397112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:02.399574 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.399548 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 00:34:02.399701 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.399594 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 00:34:02.399701 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.399601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 00:34:02.399701 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.399601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gp6kj\"" Jun 10 00:34:02.405961 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.405935 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:34:02.525137 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.525090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj4tg\" (UniqueName: \"kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg\") pod \"maas-keycloak-0\" (UID: \"4981dcae-44e7-4231-9394-59ac32d34799\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:02.626536 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.626501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj4tg\" (UniqueName: \"kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg\") pod \"maas-keycloak-0\" (UID: \"4981dcae-44e7-4231-9394-59ac32d34799\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:02.634408 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.634383 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj4tg\" (UniqueName: \"kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg\") pod \"maas-keycloak-0\" (UID: \"4981dcae-44e7-4231-9394-59ac32d34799\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:02.708759 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.708669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:02.841244 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.841217 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:34:02.843928 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:34:02.843904 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4981dcae_44e7_4231_9394_59ac32d34799.slice/crio-65647740a14b35a2c3923512fa1e9020382343f697ff84e08c3200b7aa443d78 WatchSource:0}: Error finding container 65647740a14b35a2c3923512fa1e9020382343f697ff84e08c3200b7aa443d78: Status 404 returned error can't find the container with id 65647740a14b35a2c3923512fa1e9020382343f697ff84e08c3200b7aa443d78 Jun 10 00:34:02.845768 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:02.845746 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:34:03.677976 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:03.677936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4981dcae-44e7-4231-9394-59ac32d34799","Type":"ContainerStarted","Data":"65647740a14b35a2c3923512fa1e9020382343f697ff84e08c3200b7aa443d78"} Jun 10 00:34:08.709553 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:08.709506 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4981dcae-44e7-4231-9394-59ac32d34799","Type":"ContainerStarted","Data":"2a84dd14a17c4fb130b703f6f22e475de3ec203a49d1f0f62e27b2f3794a896a"} Jun 10 00:34:08.742344 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:08.742281 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.820143893 podStartE2EDuration="6.742233275s" totalImagesPullingTime="4.922089382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:34:08.741224808 +0000 UTC m=+756.787768671" watchObservedRunningTime="2026-06-10 00:34:08.742233275 +0000 UTC m=+756.788777138" Jun 10 00:34:09.709338 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:09.709292 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:09.710992 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:09.710950 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:10.710010 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:10.709965 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:11.709369 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:11.709318 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:12.709200 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:12.709150 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:12.709542 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:12.709500 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:13.709228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:13.709179 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:14.709786 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:14.709233 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:15.710027 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:15.709980 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:16.710119 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:16.710058 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:17.709304 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:17.709238 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:18.709427 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:18.709364 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:19.709248 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:19.709203 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:20.710074 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:20.710012 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 00:34:21.843596 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:21.843555 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 00:34:21.861760 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:21.861710 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:34:31.849558 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:34:31.849520 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:12.936386 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:12.936348 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:35:24.599677 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:24.599637 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:24.600118 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:24.599835 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" containerID="cri-o://2a84dd14a17c4fb130b703f6f22e475de3ec203a49d1f0f62e27b2f3794a896a" gracePeriod=30 Jun 10 00:35:26.075885 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.075852 2560 generic.go:356] "Generic (PLEG): container finished" podID="4981dcae-44e7-4231-9394-59ac32d34799" containerID="2a84dd14a17c4fb130b703f6f22e475de3ec203a49d1f0f62e27b2f3794a896a" exitCode=143 Jun 10 00:35:26.076248 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.075904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4981dcae-44e7-4231-9394-59ac32d34799","Type":"ContainerDied","Data":"2a84dd14a17c4fb130b703f6f22e475de3ec203a49d1f0f62e27b2f3794a896a"} Jun 10 00:35:26.641092 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.641064 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:26.698003 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.697970 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj4tg\" (UniqueName: \"kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg\") pod \"4981dcae-44e7-4231-9394-59ac32d34799\" (UID: \"4981dcae-44e7-4231-9394-59ac32d34799\") " Jun 10 00:35:26.700173 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.700143 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg" (OuterVolumeSpecName: "kube-api-access-fj4tg") pod "4981dcae-44e7-4231-9394-59ac32d34799" (UID: "4981dcae-44e7-4231-9394-59ac32d34799"). InnerVolumeSpecName "kube-api-access-fj4tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:35:26.799058 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:26.799030 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj4tg\" (UniqueName: \"kubernetes.io/projected/4981dcae-44e7-4231-9394-59ac32d34799-kube-api-access-fj4tg\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\"" Jun 10 00:35:27.082834 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.082755 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.082834 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.082803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4981dcae-44e7-4231-9394-59ac32d34799","Type":"ContainerDied","Data":"65647740a14b35a2c3923512fa1e9020382343f697ff84e08c3200b7aa443d78"} Jun 10 00:35:27.083317 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.082862 2560 scope.go:117] "RemoveContainer" containerID="2a84dd14a17c4fb130b703f6f22e475de3ec203a49d1f0f62e27b2f3794a896a" Jun 10 00:35:27.103217 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.103186 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:27.104984 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.104959 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:27.123994 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.123964 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:27.124341 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.124327 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" Jun 10 00:35:27.124386 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.124343 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" Jun 10 00:35:27.124420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.124409 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4981dcae-44e7-4231-9394-59ac32d34799" containerName="keycloak" Jun 10 00:35:27.128612 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.128589 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.131153 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.131128 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gp6kj\"" Jun 10 00:35:27.131279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.131152 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 00:35:27.131279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.131186 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 00:35:27.131279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.131139 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 00:35:27.131279 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.131140 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 00:35:27.138810 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.138784 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:27.202164 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.202113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgm9p\" (UniqueName: \"kubernetes.io/projected/d4c700d1-a2c8-427a-be35-2f906d06452f-kube-api-access-bgm9p\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.202397 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.202194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d4c700d1-a2c8-427a-be35-2f906d06452f-test-realms\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.302947 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.302906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d4c700d1-a2c8-427a-be35-2f906d06452f-test-realms\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.303158 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.302981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgm9p\" (UniqueName: \"kubernetes.io/projected/d4c700d1-a2c8-427a-be35-2f906d06452f-kube-api-access-bgm9p\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.303743 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.303717 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d4c700d1-a2c8-427a-be35-2f906d06452f-test-realms\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.310921 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.310899 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgm9p\" (UniqueName: \"kubernetes.io/projected/d4c700d1-a2c8-427a-be35-2f906d06452f-kube-api-access-bgm9p\") pod \"maas-keycloak-0\" (UID: \"d4c700d1-a2c8-427a-be35-2f906d06452f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.438349 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.438212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:27.573681 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:27.573522 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:35:27.576250 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:35:27.576221 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c700d1_a2c8_427a_be35_2f906d06452f.slice/crio-2a2a9e40a4628aa69502b4232bf18a27e131cceff738ff6166432bf8962a5ae5 WatchSource:0}: Error finding container 2a2a9e40a4628aa69502b4232bf18a27e131cceff738ff6166432bf8962a5ae5: Status 404 returned error can't find the container with id 2a2a9e40a4628aa69502b4232bf18a27e131cceff738ff6166432bf8962a5ae5 Jun 10 00:35:28.090740 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.090687 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d4c700d1-a2c8-427a-be35-2f906d06452f","Type":"ContainerStarted","Data":"fdbb8e4b17fd23c6bd4cfc2c036b8dc33b9f5af26f2fdfd8aa13f4931d2ed155"} Jun 10 00:35:28.091178 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.090754 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d4c700d1-a2c8-427a-be35-2f906d06452f","Type":"ContainerStarted","Data":"2a2a9e40a4628aa69502b4232bf18a27e131cceff738ff6166432bf8962a5ae5"} Jun 10 00:35:28.110354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.110286 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.804394977 podStartE2EDuration="1.110243647s" totalImagesPullingTime="305.84867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:28.108580737 +0000 UTC m=+836.155124602" watchObservedRunningTime="2026-06-10 00:35:28.110243647 +0000 UTC m=+836.156787510" Jun 10 00:35:28.438601 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.438566 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:28.440059 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.440021 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:28.446499 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:28.446463 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4981dcae-44e7-4231-9394-59ac32d34799" path="/var/lib/kubelet/pods/4981dcae-44e7-4231-9394-59ac32d34799/volumes" Jun 10 00:35:29.439656 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:29.439603 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:30.439429 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:30.439368 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:31.439023 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:31.438967 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:32.439215 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:32.439157 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:33.439336 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:33.439289 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:34.438733 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:34.438683 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:35.439220 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:35.439167 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:36.438713 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:36.438666 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:37.439063 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:37.439005 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:37.439577 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:37.439297 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:38.439417 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:38.439349 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:39.438798 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:39.438756 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:40.438956 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:40.438900 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 10 00:35:41.539686 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:41.539634 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 00:35:41.554778 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:41.554721 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:35:51.544637 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:35:51.544585 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d4c700d1-a2c8-427a-be35-2f906d06452f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:36:01.546346 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:01.546309 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:36:22.429330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.425935 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g"] Jun 10 00:36:22.435491 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.435467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.437582 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.437553 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g"] Jun 10 00:36:22.439750 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.439726 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 00:36:22.440726 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.440698 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 00:36:22.440854 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.440737 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t5f28\"" Jun 10 00:36:22.440854 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.440751 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 00:36:22.521968 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.521936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.522161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.521997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.522161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.522039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqbg7\" (UniqueName: \"kubernetes.io/projected/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kube-api-access-gqbg7\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.522161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.522104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.522161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.522128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.522330 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.522174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.622873 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.622830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623057 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.622876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqbg7\" (UniqueName: \"kubernetes.io/projected/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kube-api-access-gqbg7\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623057 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.622926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623057 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.622955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623057 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.623010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623229 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.623080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623366 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.623343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623467 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.623433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.623467 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.623464 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.625366 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.625344 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.625559 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.625542 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.630751 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.630728 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqbg7\" (UniqueName: \"kubernetes.io/projected/7852ef7b-65f5-4302-a0bb-bd7da2a8f613-kube-api-access-gqbg7\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g\" (UID: \"7852ef7b-65f5-4302-a0bb-bd7da2a8f613\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.763477 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.763383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" Jun 10 00:36:22.777303 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.777253 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:36:22.902798 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:22.902755 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g"] Jun 10 00:36:22.905128 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:36:22.905097 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7852ef7b_65f5_4302_a0bb_bd7da2a8f613.slice/crio-3c00bbfce6d001465e7ed36551bda725e64e09339457c93f006a0d4f52a61514 WatchSource:0}: Error finding container 3c00bbfce6d001465e7ed36551bda725e64e09339457c93f006a0d4f52a61514: Status 404 returned error can't find the container with id 3c00bbfce6d001465e7ed36551bda725e64e09339457c93f006a0d4f52a61514 Jun 10 00:36:23.381129 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:23.381093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" event={"ID":"7852ef7b-65f5-4302-a0bb-bd7da2a8f613","Type":"ContainerStarted","Data":"3c00bbfce6d001465e7ed36551bda725e64e09339457c93f006a0d4f52a61514"} Jun 10 00:36:27.403128 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:27.403074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g" event={"ID":"7852ef7b-65f5-4302-a0bb-bd7da2a8f613","Type":"ContainerStarted","Data":"97bedd4952db244ea4fbbbdc57125f7b958f81f447d67f6f18f54cb2413633a6"} Jun 10 00:36:32.449939 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:32.446977 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:36:32.449939 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:32.449667 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:36:32.459865 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:32.459837 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:36:32.460388 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:32.460370 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:36:32.948730 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:32.948693 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:36:40.524565 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.524529 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25"] Jun 10 00:36:40.528180 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.528160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.530534 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.530506 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 00:36:40.538221 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.538190 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25"] Jun 10 00:36:40.579540 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm59x\" (UniqueName: \"kubernetes.io/projected/77ead182-5fea-4ac7-bd84-1007560f33f5-kube-api-access-cm59x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.579540 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.579793 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ead182-5fea-4ac7-bd84-1007560f33f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.579793 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.579793 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.579927 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.579810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.680816 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.680770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.680816 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.680817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.680837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.680873 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm59x\" (UniqueName: \"kubernetes.io/projected/77ead182-5fea-4ac7-bd84-1007560f33f5-kube-api-access-cm59x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.680892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.681029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ead182-5fea-4ac7-bd84-1007560f33f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681384 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.681348 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681384 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.681367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.681556 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.681430 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.683161 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.683140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77ead182-5fea-4ac7-bd84-1007560f33f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.683526 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.683509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ead182-5fea-4ac7-bd84-1007560f33f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.688083 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.688057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm59x\" (UniqueName: \"kubernetes.io/projected/77ead182-5fea-4ac7-bd84-1007560f33f5-kube-api-access-cm59x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25\" (UID: \"77ead182-5fea-4ac7-bd84-1007560f33f5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.839518 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.839479 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:36:40.983643 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:40.983616 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25"] Jun 10 00:36:40.986153 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:36:40.986124 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ead182_5fea_4ac7_bd84_1007560f33f5.slice/crio-a345c925ee3a9e67982b2e28c79fc4e9173a282e427fb4a9c390fb6b1e7f440b WatchSource:0}: Error finding container a345c925ee3a9e67982b2e28c79fc4e9173a282e427fb4a9c390fb6b1e7f440b: Status 404 returned error can't find the container with id a345c925ee3a9e67982b2e28c79fc4e9173a282e427fb4a9c390fb6b1e7f440b Jun 10 00:36:41.040803 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:41.040698 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:36:41.472885 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:41.472843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" event={"ID":"77ead182-5fea-4ac7-bd84-1007560f33f5","Type":"ContainerStarted","Data":"be925218cae589117fda8eada1f6e19e2f9c7f0deffab814f8433227e7f4e6e9"} Jun 10 00:36:41.473068 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:41.472914 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" event={"ID":"77ead182-5fea-4ac7-bd84-1007560f33f5","Type":"ContainerStarted","Data":"a345c925ee3a9e67982b2e28c79fc4e9173a282e427fb4a9c390fb6b1e7f440b"} Jun 10 00:36:51.520547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:51.520450 2560 generic.go:356] "Generic (PLEG): container finished" podID="77ead182-5fea-4ac7-bd84-1007560f33f5" containerID="be925218cae589117fda8eada1f6e19e2f9c7f0deffab814f8433227e7f4e6e9" exitCode=0 Jun 10 00:36:51.520547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:51.520497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" event={"ID":"77ead182-5fea-4ac7-bd84-1007560f33f5","Type":"ContainerDied","Data":"be925218cae589117fda8eada1f6e19e2f9c7f0deffab814f8433227e7f4e6e9"} Jun 10 00:36:53.531605 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:53.531569 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" event={"ID":"77ead182-5fea-4ac7-bd84-1007560f33f5","Type":"ContainerStarted","Data":"a91ec33a3b7555f464453f9b9be9b3c0e481a73c7fb082a251833267c16cbe54"} Jun 10 00:36:53.549276 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:53.549209 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" podStartSLOduration=2.365636778 podStartE2EDuration="13.549194357s" totalImagesPullingTime="1.026042577s" totalInitContainerRuntime="10.157515002s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:53.54791195 +0000 UTC m=+921.594455832" watchObservedRunningTime="2026-06-10 00:36:53.549194357 +0000 UTC m=+921.595738219" Jun 10 00:36:54.220022 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.219985 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55"] Jun 10 00:36:54.247819 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.247773 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55"] Jun 10 00:36:54.247979 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.247892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.250424 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.250399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 00:36:54.306830 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.306790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.306830 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.306838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.307047 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.306924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.307047 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.306967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pfj\" (UniqueName: \"kubernetes.io/projected/93135847-9f30-45d7-9fce-c72cc819026c-kube-api-access-68pfj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.307115 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.307073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93135847-9f30-45d7-9fce-c72cc819026c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.307115 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.307102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408389 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pfj\" (UniqueName: \"kubernetes.io/projected/93135847-9f30-45d7-9fce-c72cc819026c-kube-api-access-68pfj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93135847-9f30-45d7-9fce-c72cc819026c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408547 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408714 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.408945 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.409025 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.409025 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.408956 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.410710 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.410687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93135847-9f30-45d7-9fce-c72cc819026c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.410862 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.410846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93135847-9f30-45d7-9fce-c72cc819026c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.416332 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.416308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pfj\" (UniqueName: \"kubernetes.io/projected/93135847-9f30-45d7-9fce-c72cc819026c-kube-api-access-68pfj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55\" (UID: \"93135847-9f30-45d7-9fce-c72cc819026c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.558845 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.558803 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:36:54.695739 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.695711 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55"] Jun 10 00:36:54.698164 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:36:54.698134 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93135847_9f30_45d7_9fce_c72cc819026c.slice/crio-457b41f2d2e11f52942304d51487f0cd218c28d7f953ba9bcfe2fb7568dd6e8e WatchSource:0}: Error finding container 457b41f2d2e11f52942304d51487f0cd218c28d7f953ba9bcfe2fb7568dd6e8e: Status 404 returned error can't find the container with id 457b41f2d2e11f52942304d51487f0cd218c28d7f953ba9bcfe2fb7568dd6e8e Jun 10 00:36:54.948371 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:54.948277 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:36:55.542180 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:55.542140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" event={"ID":"93135847-9f30-45d7-9fce-c72cc819026c","Type":"ContainerStarted","Data":"d79c87dd2ce069d0d5a82e5bb0bef0408694df1d43e6fb2baba5105b51799f88"} Jun 10 00:36:55.542420 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:55.542193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" event={"ID":"93135847-9f30-45d7-9fce-c72cc819026c","Type":"ContainerStarted","Data":"457b41f2d2e11f52942304d51487f0cd218c28d7f953ba9bcfe2fb7568dd6e8e"} Jun 10 00:36:56.548028 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:56.547995 2560 generic.go:356] "Generic (PLEG): container finished" podID="93135847-9f30-45d7-9fce-c72cc819026c" containerID="d79c87dd2ce069d0d5a82e5bb0bef0408694df1d43e6fb2baba5105b51799f88" exitCode=0 Jun 10 00:36:56.548441 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:56.548075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" event={"ID":"93135847-9f30-45d7-9fce-c72cc819026c","Type":"ContainerDied","Data":"d79c87dd2ce069d0d5a82e5bb0bef0408694df1d43e6fb2baba5105b51799f88"} Jun 10 00:36:57.554762 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:57.554726 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" event={"ID":"93135847-9f30-45d7-9fce-c72cc819026c","Type":"ContainerStarted","Data":"6ad281cbf7fdbf35f0595d3eeeadc37f7b8df2a16d7e0fe49dbc0d1180d2f334"} Jun 10 00:36:57.572871 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:36:57.572818 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" podStartSLOduration=1.8884600630000001 podStartE2EDuration="3.572798112s" totalImagesPullingTime="189.943053ms" totalInitContainerRuntime="1.494394996s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:57.571240565 +0000 UTC m=+925.617784428" watchObservedRunningTime="2026-06-10 00:36:57.572798112 +0000 UTC m=+925.619341997" Jun 10 00:37:00.839870 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:00.839829 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:37:00.840358 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:00.839889 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:37:00.853013 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:00.852985 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:37:01.584782 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:01.584753 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25" Jun 10 00:37:04.559382 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:04.559324 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:37:04.559852 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:04.559415 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:37:04.572482 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:04.572453 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:37:04.598808 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:04.598769 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55" Jun 10 00:37:20.150911 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:20.150871 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:37:36.142603 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:37:36.142564 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t8xrh"] Jun 10 00:41:32.489834 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:41:32.489801 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:41:32.490525 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:41:32.490501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:41:32.497747 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:41:32.497723 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:41:32.497948 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:41:32.497932 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbqmc_2afacfef-234d-4bde-ae5c-92ca1de036eb/ovn-acl-logging/0.log" Jun 10 00:43:31.186590 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:31.186560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-hx8cc_144abd22-c58c-4a94-8888-626c473b6469/copy-manifests/0.log" Jun 10 00:43:31.199914 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:31.199884 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-hx8cc_144abd22-c58c-4a94-8888-626c473b6469/manager/0.log" Jun 10 00:43:33.321835 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:33.321804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b7mvc_d24087e1-b48d-4aee-a446-1879ae9b47fd/manager/0.log" Jun 10 00:43:33.433222 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:33.433192 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t8xrh_d19ef9e9-3ae5-4c95-8b01-8d158dc760fa/limitador/0.log" Jun 10 00:43:34.307247 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:34.307214 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-w2br9_96ed330d-ddb7-4af2-b1e1-f713df77b1b9/kube-auth-proxy/0.log" Jun 10 00:43:35.140848 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:35.140815 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-f4t5g_7852ef7b-65f5-4302-a0bb-bd7da2a8f613/storage-initializer/0.log" Jun 10 00:43:35.394214 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:35.394135 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25_77ead182-5fea-4ac7-bd84-1007560f33f5/main/0.log" Jun 10 00:43:35.399712 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:35.399688 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z5l25_77ead182-5fea-4ac7-bd84-1007560f33f5/storage-initializer/0.log" Jun 10 00:43:35.519781 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:35.519751 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55_93135847-9f30-45d7-9fce-c72cc819026c/storage-initializer/0.log" Jun 10 00:43:35.526749 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:35.526720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk55_93135847-9f30-45d7-9fce-c72cc819026c/main/0.log" Jun 10 00:43:43.083614 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:43.083582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8n52q_9b24f943-2775-46bf-9466-a6806a10f790/global-pull-secret-syncer/0.log" Jun 10 00:43:43.200430 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:43.200402 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-924kb_1b3a1239-2c31-46ba-8882-96405a4e2209/konnectivity-agent/0.log" Jun 10 00:43:43.280076 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:43.280038 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-91.ec2.internal_54af077af9c0dd29d16ee84c02a23950/haproxy/0.log" Jun 10 00:43:48.513573 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:48.513540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b7mvc_d24087e1-b48d-4aee-a446-1879ae9b47fd/manager/0.log" Jun 10 00:43:48.545790 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:48.545756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t8xrh_d19ef9e9-3ae5-4c95-8b01-8d158dc760fa/limitador/0.log" Jun 10 00:43:50.304735 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.304703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-9rl6l_73cf0f13-17aa-4d2d-a729-2e2e0ab981b6/cluster-monitoring-operator/0.log" Jun 10 00:43:50.550901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.550876 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/node-exporter/0.log" Jun 10 00:43:50.573577 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.573452 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/kube-rbac-proxy/0.log" Jun 10 00:43:50.596823 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.596797 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tkwwv_aedf11b8-3082-409d-8bd4-757d323d66db/init-textfile/0.log" Jun 10 00:43:50.784933 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.784903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/prometheus/0.log" Jun 10 00:43:50.806292 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.806254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/config-reloader/0.log" Jun 10 00:43:50.828608 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.828522 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/thanos-sidecar/0.log" Jun 10 00:43:50.850249 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.850223 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/kube-rbac-proxy-web/0.log" Jun 10 00:43:50.872803 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.872748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/kube-rbac-proxy/0.log" Jun 10 00:43:50.894595 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.894546 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/kube-rbac-proxy-thanos/0.log" Jun 10 00:43:50.921752 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.921726 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22101741-d36e-4522-a5c1-84807f530c9e/init-config-reloader/0.log" Jun 10 00:43:50.958516 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.958464 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gjfpv_542f90a0-746c-4044-a588-a9ea58af30ec/prometheus-operator/0.log" Jun 10 00:43:50.977372 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:50.977323 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gjfpv_542f90a0-746c-4044-a588-a9ea58af30ec/kube-rbac-proxy/0.log" Jun 10 00:43:51.039095 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:51.039063 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/telemeter-client/0.log" Jun 10 00:43:51.059994 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:51.059968 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/reload/0.log" Jun 10 00:43:51.080085 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:51.079995 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788d894b74-nttgm_cbe1d61b-6dfd-4c99-9133-b0ce5d61034f/kube-rbac-proxy/0.log" Jun 10 00:43:53.154471 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.154434 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/2.log" Jun 10 00:43:53.164967 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.164929 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8hc24_5675b030-ea93-41cc-8c77-4bcc7519d79d/console-operator/3.log" Jun 10 00:43:53.450251 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.450169 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb"] Jun 10 00:43:53.453616 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.453598 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.456152 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.456133 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h66sf\"/\"kube-root-ca.crt\"" Jun 10 00:43:53.457120 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.457099 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h66sf\"/\"default-dockercfg-cn279\"" Jun 10 00:43:53.457218 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.457099 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h66sf\"/\"openshift-service-ca.crt\"" Jun 10 00:43:53.460228 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.460206 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb"] Jun 10 00:43:53.621642 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.621608 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-podres\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.621836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.621661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-sys\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.621836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.621692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klpx\" (UniqueName: \"kubernetes.io/projected/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-kube-api-access-5klpx\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.621836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.621751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-proc\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.621836 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.621767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-lib-modules\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722660 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-proc\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722660 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-lib-modules\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722660 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-podres\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-sys\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5klpx\" (UniqueName: \"kubernetes.io/projected/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-kube-api-access-5klpx\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722692 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-proc\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-sys\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-lib-modules\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.722901 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.722811 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-podres\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.730211 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.730179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klpx\" (UniqueName: \"kubernetes.io/projected/5679a106-8b26-4f0d-b0c8-9e2107f35fc3-kube-api-access-5klpx\") pod \"perf-node-gather-daemonset-msxlb\" (UID: \"5679a106-8b26-4f0d-b0c8-9e2107f35fc3\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.765064 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.765031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:53.899443 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:53.899409 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb"] Jun 10 00:43:53.901604 ip-10-0-130-91 kubenswrapper[2560]: W0610 00:43:53.901578 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5679a106_8b26_4f0d_b0c8_9e2107f35fc3.slice/crio-542c68354f58491907ae9f8b0da51b420972f30123de4fe83f4fc1f58098d5b7 WatchSource:0}: Error finding container 542c68354f58491907ae9f8b0da51b420972f30123de4fe83f4fc1f58098d5b7: Status 404 returned error can't find the container with id 542c68354f58491907ae9f8b0da51b420972f30123de4fe83f4fc1f58098d5b7 Jun 10 00:43:54.434688 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:54.434652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-zd6nv_cb6f56d2-eaca-482d-bdd3-653381c31bb4/volume-data-source-validator/0.log" Jun 10 00:43:54.485299 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:54.485249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" event={"ID":"5679a106-8b26-4f0d-b0c8-9e2107f35fc3","Type":"ContainerStarted","Data":"84f026be0ec574e45cf984b164cca14d352c134111cc89f42094903667e2a340"} Jun 10 00:43:54.485473 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:54.485314 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" event={"ID":"5679a106-8b26-4f0d-b0c8-9e2107f35fc3","Type":"ContainerStarted","Data":"542c68354f58491907ae9f8b0da51b420972f30123de4fe83f4fc1f58098d5b7"} Jun 10 00:43:54.485473 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:54.485340 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:43:54.500328 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:54.500275 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" podStartSLOduration=1.50024212 podStartE2EDuration="1.50024212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:43:54.499379957 +0000 UTC m=+1342.545923852" watchObservedRunningTime="2026-06-10 00:43:54.50024212 +0000 UTC m=+1342.546785983" Jun 10 00:43:55.692879 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:55.692851 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9gfx5_0c017017-a832-4419-bb15-ccb04cbf1b1e/dns/0.log" Jun 10 00:43:55.714422 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:55.714399 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9gfx5_0c017017-a832-4419-bb15-ccb04cbf1b1e/kube-rbac-proxy/0.log" Jun 10 00:43:55.782007 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:55.781974 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wd98q_dee347e3-515f-4143-a61c-46bcd4f56d22/dns-node-resolver/0.log" Jun 10 00:43:56.366354 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:56.366328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j874n_cd05a87e-1be8-4bf7-8473-682fc3207ce7/node-ca/0.log" Jun 10 00:43:57.405079 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:57.405048 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-w2br9_96ed330d-ddb7-4af2-b1e1-f713df77b1b9/kube-auth-proxy/0.log" Jun 10 00:43:58.119040 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.119008 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kl2vz_51d97a1a-b9c0-4d9c-a462-aca1e9abda84/serve-healthcheck-canary/0.log" Jun 10 00:43:58.625373 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.625338 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ddq87_8502e466-d3ff-4a34-8c54-7f7ccac29760/insights-operator/0.log" Jun 10 00:43:58.627633 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.627602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ddq87_8502e466-d3ff-4a34-8c54-7f7ccac29760/insights-operator/1.log" Jun 10 00:43:58.652672 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.652643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhmg7_898872ad-556e-4326-9c00-eff70cda55ec/kube-rbac-proxy/0.log" Jun 10 00:43:58.674500 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.674473 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhmg7_898872ad-556e-4326-9c00-eff70cda55ec/exporter/0.log" Jun 10 00:43:58.697175 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:43:58.697142 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhmg7_898872ad-556e-4326-9c00-eff70cda55ec/extractor/0.log" Jun 10 00:44:00.500367 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:00.500339 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-msxlb" Jun 10 00:44:01.266147 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:01.266105 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-hx8cc_144abd22-c58c-4a94-8888-626c473b6469/manager/0.log" Jun 10 00:44:01.284820 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:01.284796 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-hx8cc_144abd22-c58c-4a94-8888-626c473b6469/copy-manifests/0.log" Jun 10 00:44:02.966728 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:02.966702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf5b49598-gn62j_131c9b17-38a8-4c17-9c12-3c03ce89aa4f/manager/0.log" Jun 10 00:44:08.122566 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:08.122536 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sgpxz_df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1/migrator/0.log" Jun 10 00:44:08.142464 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:08.142432 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sgpxz_df6c2bfc-2a9a-4217-b2c5-f1febb75d6f1/graceful-termination/0.log" Jun 10 00:44:08.485579 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:08.485492 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-w2br9_96ed330d-ddb7-4af2-b1e1-f713df77b1b9/kube-auth-proxy/0.log" Jun 10 00:44:09.743708 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:09.743682 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-w2br9_96ed330d-ddb7-4af2-b1e1-f713df77b1b9/kube-auth-proxy/0.log" Jun 10 00:44:09.987230 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:09.987145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/kube-multus-additional-cni-plugins/0.log" Jun 10 00:44:10.008094 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.008071 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/egress-router-binary-copy/0.log" Jun 10 00:44:10.027518 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.027487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/cni-plugins/0.log" Jun 10 00:44:10.047528 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.047502 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/bond-cni-plugin/0.log" Jun 10 00:44:10.068233 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.068202 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/routeoverride-cni/0.log" Jun 10 00:44:10.090345 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.090316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/whereabouts-cni-bincopy/0.log" Jun 10 00:44:10.109993 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.109964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jcths_898fd31e-6c77-43ef-84b4-3cac036e245f/whereabouts-cni/0.log" Jun 10 00:44:10.210313 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.210278 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sjn5c_4e537f10-ef8c-4fff-bb10-a051fb172084/kube-multus/0.log" Jun 10 00:44:10.316086 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.316057 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pm8pj_96a93ca9-0162-4610-89ee-96b20937fdbf/network-metrics-daemon/0.log" Jun 10 00:44:10.335401 ip-10-0-130-91 kubenswrapper[2560]: I0610 00:44:10.335375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pm8pj_96a93ca9-0162-4610-89ee-96b20937fdbf/kube-rbac-proxy/0.log"