Jul 09 15:23:59.336004 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 15:23:59.336017 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 15:23:59.336027 ip-10-0-137-233 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 15:23:59.336362 ip-10-0-137-233 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 15:24:09.523911 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 15:24:09.523933 ip-10-0-137-233 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1e7ec18c8d5f4ca79b745ccd53247d1d -- Jul 09 15:26:16.101575 ip-10-0-137-233 systemd[1]: Starting Kubernetes Kubelet... Jul 09 15:26:16.521804 ip-10-0-137-233 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:16.521804 ip-10-0-137-233 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 15:26:16.521804 ip-10-0-137-233 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:16.521804 ip-10-0-137-233 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 15:26:16.521804 ip-10-0-137-233 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:16.522980 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.521861 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 15:26:16.525428 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525279 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.525428 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525427 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525430 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525433 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525436 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525439 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525441 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525444 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525446 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525449 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525453 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525455 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525458 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525461 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.525502 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525463 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525519 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525580 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525585 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525589 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525594 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525599 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525603 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525606 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525609 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525611 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525614 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525617 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525620 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525623 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525629 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525631 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525634 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525637 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.525953 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525640 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.526624 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525644 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.526624 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525648 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.526624 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525655 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.526624 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525659 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.526624 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.525666 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.527137 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527118 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.527169 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527142 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.527169 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527148 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.527222 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527161 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.527222 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527187 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.527299 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527224 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.527366 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527357 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.527366 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527366 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527373 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527377 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527381 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527384 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527387 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527390 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527394 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527397 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527402 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527406 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527412 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527416 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527418 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527421 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527424 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.527421 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527427 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527430 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527433 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527435 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527438 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527440 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527443 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527446 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527448 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527451 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527453 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527456 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527459 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527462 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527466 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527469 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527471 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527474 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527476 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.527808 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527479 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527482 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527485 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527487 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527490 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527492 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527495 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527498 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527501 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527503 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527506 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527509 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527512 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527514 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527517 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527520 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527524 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.528286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.527526 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528315 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528322 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528325 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528328 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528331 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528333 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528336 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528339 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528341 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528344 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528346 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528349 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528351 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528355 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528357 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528360 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528363 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528365 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528368 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.528695 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528370 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528373 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528376 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528378 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528380 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528384 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528388 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528391 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528394 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528396 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528399 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528401 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528404 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528406 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528409 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528412 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528415 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528418 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528420 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.529329 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528427 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528430 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528433 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528435 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528437 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528440 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528443 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528445 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528447 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528450 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528455 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528458 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528461 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528464 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528467 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528469 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528472 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528475 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528477 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.529807 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528480 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528482 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528485 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528487 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528490 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528492 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528494 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528497 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528500 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528503 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528506 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528509 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528513 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528515 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528517 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528520 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528522 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528525 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528527 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528529 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.530310 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528533 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528536 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528539 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528542 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528544 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528546 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528548 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528551 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528553 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528555 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528558 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528560 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528563 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528565 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528567 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528570 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528572 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528574 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528577 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528579 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.530793 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528583 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528587 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528981 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528986 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528989 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528991 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528994 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.528997 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529000 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529003 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529005 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529008 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529011 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529013 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529016 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529018 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529022 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529025 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529028 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529030 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.531297 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529033 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529035 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529038 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529040 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529042 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529045 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529047 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529050 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529052 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529055 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529057 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529060 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529065 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529068 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529071 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529073 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529075 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529078 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529081 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529083 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.531783 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529086 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529088 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529090 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529094 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529096 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529098 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529101 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529103 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529106 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529108 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529110 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529113 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529115 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529118 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529120 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529122 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529126 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529130 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529132 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.532298 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529135 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529138 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529141 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529144 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529147 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529151 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529153 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529157 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529159 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529162 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529165 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529168 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529170 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529173 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529175 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529178 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529180 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529184 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529187 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529189 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.532782 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529192 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529195 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529197 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529200 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529203 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529206 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529209 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529211 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529214 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529216 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529219 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529221 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529224 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529226 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529228 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529232 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529249 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529253 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529256 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529258 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.533286 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529262 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529264 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529336 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529344 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529350 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529355 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529359 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529362 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529366 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529370 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529374 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529377 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529381 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529384 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529387 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529390 2557 flags.go:64] FLAG: --cgroup-root="" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529393 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529396 2557 flags.go:64] FLAG: --client-ca-file="" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529398 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529401 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529406 2557 flags.go:64] FLAG: --cluster-domain="" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529409 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529412 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529415 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 15:26:16.533785 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529418 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529422 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529424 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529429 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529432 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529436 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529439 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529442 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529445 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529449 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529453 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529456 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529458 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529461 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529464 2557 flags.go:64] FLAG: --enable-server="true" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529467 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529471 2557 flags.go:64] FLAG: --event-burst="100" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529474 2557 flags.go:64] FLAG: --event-qps="50" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529477 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529480 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529483 2557 flags.go:64] FLAG: --eviction-hard="" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529487 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529490 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529492 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529495 2557 flags.go:64] FLAG: --eviction-soft="" Jul 09 15:26:16.534429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529498 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529501 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529504 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529506 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529509 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529512 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529515 2557 flags.go:64] FLAG: --feature-gates="" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529519 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529521 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529524 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529530 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529533 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529536 2557 flags.go:64] FLAG: --help="false" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529539 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529542 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529545 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529548 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529552 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529555 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529558 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529561 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529563 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529566 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 15:26:16.535062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529569 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529572 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529575 2557 flags.go:64] FLAG: --kube-reserved="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529578 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529580 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529583 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529586 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529589 2557 flags.go:64] FLAG: --lock-file="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529591 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529594 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529597 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529603 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529605 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529608 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529611 2557 flags.go:64] FLAG: --logging-format="text" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529614 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529617 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529620 2557 flags.go:64] FLAG: --manifest-url="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529622 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529627 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529630 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529635 2557 flags.go:64] FLAG: --max-pods="110" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529638 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529641 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529643 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 15:26:16.535674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529646 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529650 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529653 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529656 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529663 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529667 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529670 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529673 2557 flags.go:64] FLAG: --pod-cidr="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529676 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529682 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529685 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529688 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529691 2557 flags.go:64] FLAG: --port="10250" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529694 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529697 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-093a01c650ba8b354" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529700 2557 flags.go:64] FLAG: --qos-reserved="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529703 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529706 2557 flags.go:64] FLAG: --register-node="true" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529709 2557 flags.go:64] FLAG: --register-with-taints="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529712 2557 flags.go:64] FLAG: --registry-burst="10" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529715 2557 flags.go:64] FLAG: --registry-qps="5" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529718 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529721 2557 flags.go:64] FLAG: --reserved-memory="" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529724 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529727 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 15:26:16.536348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529730 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529733 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529737 2557 flags.go:64] FLAG: --runonce="false" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529740 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529743 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529746 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529748 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529751 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529755 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529757 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529761 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529764 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529767 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529770 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529773 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529776 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529778 2557 flags.go:64] FLAG: --system-cgroups="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529781 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529786 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529789 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529792 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529797 2557 flags.go:64] FLAG: --tls-min-version="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529800 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529802 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529805 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 15:26:16.536964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529808 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529811 2557 flags.go:64] FLAG: --v="2" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529815 2557 flags.go:64] FLAG: --version="false" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529819 2557 flags.go:64] FLAG: --vmodule="" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529824 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.529827 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529954 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529959 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529962 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529967 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529970 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529974 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529977 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529980 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529983 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529985 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529988 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529990 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529993 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529996 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.529999 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.537587 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530002 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530004 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530008 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530010 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530013 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530015 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530018 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530020 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530023 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530026 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530028 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530030 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530033 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530035 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530038 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530043 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530045 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530048 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530050 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.538111 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530053 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530056 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530059 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530061 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530064 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530066 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530069 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530073 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530076 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530079 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530082 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530085 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530088 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530091 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530094 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530097 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530099 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530101 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530104 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.538632 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530106 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530109 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530111 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530113 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530116 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530118 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530120 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530123 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530125 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530129 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530131 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530134 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530136 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530138 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530142 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530144 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530147 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530149 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530152 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530154 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.539099 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530156 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530159 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530161 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530164 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530166 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530170 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530172 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530175 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530177 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530179 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530182 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530184 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530187 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530189 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530192 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530194 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530196 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530199 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530201 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530204 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.539616 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530206 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530209 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530212 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530214 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530217 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.530219 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.530780 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.537437 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.537455 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.537474 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.537480 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537537 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537541 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537544 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.540095 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537547 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537550 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537552 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537556 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537560 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537563 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537565 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537568 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537571 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537574 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537576 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537579 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537581 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537584 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537587 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537590 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537593 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537596 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537598 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.540520 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537601 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537604 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537606 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537609 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537611 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537614 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537617 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537620 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537622 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537625 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537627 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537631 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537635 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537638 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537641 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537644 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537646 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537649 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537652 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537655 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.541002 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537658 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537660 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537663 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537666 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537668 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537670 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537673 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537676 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537678 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537680 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537683 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537686 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537688 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537692 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537695 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537699 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537702 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537705 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537708 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537711 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.541512 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537715 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537717 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537720 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537722 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537725 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537727 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537730 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537732 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537735 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537737 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537740 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537743 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537745 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537748 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537750 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537752 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537755 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537757 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537760 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.542372 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537762 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537765 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537767 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537769 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537773 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537776 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537778 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537780 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537783 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537786 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537788 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537791 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537793 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537796 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537799 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537802 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537804 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.542991 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537806 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.537811 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537926 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537939 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537942 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537945 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537948 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537953 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537957 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537960 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537962 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537965 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537968 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537971 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:16.543453 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537974 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537976 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537979 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537981 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537984 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537986 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537988 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537991 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537993 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537996 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.537998 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538002 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538004 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538007 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538010 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538012 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538015 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538017 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538019 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538022 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:16.543867 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538024 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538026 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538029 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538031 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538033 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538036 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538038 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538041 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538043 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538046 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538048 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538050 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538052 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538055 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538058 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538060 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538062 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538065 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538067 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538069 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:16.544363 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538072 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538074 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538077 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538079 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538082 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538086 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538088 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538091 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538093 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538096 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538098 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538101 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538104 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538107 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538109 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538112 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538115 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538117 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538120 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538124 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:16.544985 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538126 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538129 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538132 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538134 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538136 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538139 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538141 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538143 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538147 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538150 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538153 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538156 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538159 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538161 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538164 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538166 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538169 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538172 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538174 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:16.545804 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538177 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538179 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538182 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538185 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538187 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538189 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538192 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:16.538194 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.538199 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.538334 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.540290 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.541487 2557 server.go:1019] "Starting client certificate rotation" Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.541610 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:16.546418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.541708 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:16.546768 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.543993 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:16.548493 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.548468 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:16.559773 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.559752 2557 log.go:25] "Validated CRI v1 runtime API" Jul 09 15:26:16.561917 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.561899 2557 log.go:25] "Validated CRI v1 image API" Jul 09 15:26:16.564032 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.564012 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 15:26:16.567116 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.567096 2557 fs.go:135] Filesystem UUIDs: map[2635b502-2c40-4461-943e-1b897191b13a:/dev/nvme0n1p3 6e510a7b-a5e4-40ef-b13f-5a56b312e0cc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 15:26:16.567177 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.567117 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 15:26:16.573268 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.573132 2557 manager.go:216] Machine: {Timestamp:2026-07-09 15:26:16.570872155 +0000 UTC m=+0.349612955 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117987 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2afab16b3c74ab3d20265e25b8e752 SystemUUID:ec2afab1-6b3c-74ab-3d20-265e25b8e752 BootID:1e7ec18c-8d5f-4ca7-9b74-5ccd53247d1d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:de:33:fe:47:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:de:33:fe:47:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:62:5b:f0:9e:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 15:26:16.573268 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.573265 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 15:26:16.573413 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.573398 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 15:26:16.577113 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.577085 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 15:26:16.577275 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.577115 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 15:26:16.577915 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.577905 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 15:26:16.577977 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.577917 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 15:26:16.577977 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.577941 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:16.578047 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.578019 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:16.578582 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.578570 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:16.579754 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.579743 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 15:26:16.583404 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583390 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:16.583533 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583524 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 15:26:16.583575 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583554 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 09 15:26:16.583575 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583565 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 15:26:16.583661 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583582 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 15:26:16.583661 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583591 2557 kubelet.go:398] "Adding apiserver pod source" Jul 09 15:26:16.583661 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.583651 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 15:26:16.584170 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.584155 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:16.584263 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.584180 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:16.586366 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.586349 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 15:26:16.588122 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588107 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 15:26:16.588193 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588139 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 15:26:16.588317 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588306 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 15:26:16.588373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588321 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 15:26:16.588373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588327 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 15:26:16.588373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588331 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 15:26:16.588373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588340 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 15:26:16.588373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.588345 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 15:26:16.589019 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589010 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 15:26:16.589019 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589020 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 15:26:16.589071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589026 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 15:26:16.589071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589032 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 15:26:16.589071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589040 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 15:26:16.589071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.589047 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 15:26:16.590656 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.590641 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 15:26:16.590656 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.590651 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 15:26:16.593628 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.593598 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 15:26:16.593721 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.593601 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 15:26:16.593721 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.593256 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 15:26:16.594056 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.594044 2557 server.go:1268] "Started kubelet" Jul 09 15:26:16.594179 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.594117 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 15:26:16.594299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.594158 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 15:26:16.594299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.594266 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 15:26:16.595062 ip-10-0-137-233 systemd[1]: Started Kubernetes Kubelet. Jul 09 15:26:16.598333 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.598311 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 09 15:26:16.599955 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.599914 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 15:26:16.600620 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.600602 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 15:26:16.602697 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.601637 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-233.ec2.internal.18c0a88d2471ee3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-233.ec2.internal,UID:ip-10-0-137-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-233.ec2.internal,},FirstTimestamp:2026-07-09 15:26:16.594017851 +0000 UTC m=+0.372758652,LastTimestamp:2026-07-09 15:26:16.594017851 +0000 UTC m=+0.372758652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-233.ec2.internal,}" Jul 09 15:26:16.604699 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.604683 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 15:26:16.604770 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.604718 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:16.604820 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.604764 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:16.605331 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605259 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 15:26:16.605331 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605277 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 15:26:16.605500 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605378 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 09 15:26:16.605500 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605387 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 09 15:26:16.605500 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605410 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 15:26:16.605851 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605837 2557 factory.go:153] Registering CRI-O factory Jul 09 15:26:16.605924 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605854 2557 factory.go:223] Registration of the crio container factory successfully Jul 09 15:26:16.605924 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605905 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 15:26:16.605924 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605915 2557 factory.go:55] Registering systemd factory Jul 09 15:26:16.605924 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605924 2557 factory.go:223] Registration of the systemd container factory successfully Jul 09 15:26:16.606095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605973 2557 factory.go:103] Registering Raw factory Jul 09 15:26:16.606095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.605988 2557 manager.go:1196] Started watching for new ooms in manager Jul 09 15:26:16.606414 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.606401 2557 manager.go:349] Starting recovery of all containers Jul 09 15:26:16.610130 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.610103 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 15:26:16.610130 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.610106 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 15:26:16.615982 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.615967 2557 manager.go:354] Recovery completed Jul 09 15:26:16.616285 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.616267 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pbvd" Jul 09 15:26:16.620459 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.620445 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.622687 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.622665 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.622765 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.622700 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.622765 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.622712 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.623308 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.623290 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 15:26:16.623308 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.623307 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 15:26:16.623418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.623311 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.623418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.623324 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:16.624046 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.624022 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.624129 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.624024 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pbvd" Jul 09 15:26:16.624129 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.624057 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.624129 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.624119 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.624957 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.624885 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-233.ec2.internal.18c0a88d26274efe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-233.ec2.internal,UID:ip-10-0-137-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-233.ec2.internal,},FirstTimestamp:2026-07-09 15:26:16.622681854 +0000 UTC m=+0.401422657,LastTimestamp:2026-07-09 15:26:16.622681854 +0000 UTC m=+0.401422657,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-233.ec2.internal,}" Jul 09 15:26:16.625347 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.625333 2557 policy_none.go:49] "None policy: Start" Jul 09 15:26:16.625430 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.625352 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 15:26:16.625430 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.625366 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 15:26:16.627768 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.627756 2557 policy_none.go:47] "Start" Jul 09 15:26:16.666774 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.666753 2557 manager.go:337] "Starting Device Plugin manager" Jul 09 15:26:16.666879 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.666845 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 15:26:16.666879 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.666860 2557 server.go:87] "Starting device plugin registration server" Jul 09 15:26:16.667144 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.667129 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 15:26:16.667216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.667145 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 15:26:16.667216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.667200 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 15:26:16.667342 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.667305 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 15:26:16.667342 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.667316 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 15:26:16.667873 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.667856 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 15:26:16.667945 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.667908 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:16.767771 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.767734 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.770000 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.769980 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.770090 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.770023 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.770090 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.770037 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.770090 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.770071 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.778096 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.778026 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.778096 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.778059 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-233.ec2.internal\": node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:16.787136 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.787107 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 15:26:16.788503 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.788487 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 15:26:16.788557 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.788524 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 15:26:16.788557 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.788544 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 15:26:16.788640 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.788632 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 15:26:16.792037 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.792011 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:16.805372 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.805351 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:16.889073 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.889029 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"] Jul 09 15:26:16.889263 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.889127 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.890166 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.890149 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.890218 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.890182 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.890218 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.890193 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.892559 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.892547 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.892673 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.892657 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.892727 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.892688 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.893380 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893359 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.893481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893395 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.893481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893407 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.893481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893361 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.893481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893460 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.893481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.893475 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.895716 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.895698 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.895758 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.895732 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:16.896406 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.896386 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:16.896493 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.896417 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:16.896493 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.896428 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:16.905884 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.905859 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:16.907016 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.906997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.907094 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.907028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.907094 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:16.907055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.921061 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.921040 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-233.ec2.internal\" not found" node="ip-10-0-137-233.ec2.internal" Jul 09 15:26:16.925445 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:16.925425 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-233.ec2.internal\" not found" node="ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.005954 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.005916 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:17.008027 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.008088 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.008088 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.008185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.008185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.008185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.008139 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.106573 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.106502 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:17.207170 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.207119 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:17.222630 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.222591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.227930 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.227904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.308921 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.308874 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:17.409702 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.409629 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found" Jul 09 15:26:17.458275 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.458238 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:17.505772 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.505736 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.518825 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.518797 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:17.520827 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.520810 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" Jul 09 15:26:17.532402 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.532379 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:17.541208 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.541171 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 15:26:17.541394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.541373 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:17.541436 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.541403 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:17.584012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.583969 2557 apiserver.go:52] "Watching apiserver" Jul 09 15:26:17.601485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.601452 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 15:26:17.601837 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.601814 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d","openshift-cluster-node-tuning-operator/tuned-9l8p6","openshift-network-operator/iptables-alerter-k6t4j","openshift-ovn-kubernetes/ovnkube-node-q9v9p","kube-system/global-pull-secret-syncer-25mk8","openshift-dns/node-resolver-nflcx","openshift-image-registry/node-ca-b2zl9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-f5w46","openshift-multus/multus-nlj5c","openshift-multus/network-metrics-daemon-8sb66","openshift-network-diagnostics/network-check-target-fpfd6","kube-system/konnectivity-agent-pgmkv","kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"] Jul 09 15:26:17.604496 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.604474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.604830 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.604808 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:17.607584 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.607556 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 15:26:17.608312 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.607876 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.608312 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.607937 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.608312 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.607881 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hcd6f\"" Jul 09 15:26:17.608312 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.608039 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.610423 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.610402 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.610566 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.610539 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.610816 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.610802 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.611547 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611525 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-shbn2\"" Jul 09 15:26:17.611643 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611596 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-registration-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.611643 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-conf\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611700 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-systemd\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611717 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-lib-modules\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jd9\" (UniqueName: \"kubernetes.io/projected/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-kube-api-access-t2jd9\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-socket-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-sys-fs\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611793 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysconfig\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611812 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-run\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611851 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-var-lib-kubelet\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-tmp\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.611891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611890 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-device-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-etc-selinux\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-modprobe-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-host\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.611999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-tuned\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrwts\" (UniqueName: \"kubernetes.io/projected/0711ae0a-af8c-4645-acb9-2623a862c749-kube-api-access-jrwts\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612120 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-kubernetes\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.612191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-sys\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.612686 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612668 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-67lj8\"" Jul 09 15:26:17.612830 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.612950 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612934 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 15:26:17.613050 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.612936 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.613270 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.613238 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.615107 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.615090 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.615225 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.615203 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:17.615516 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.615502 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 15:26:17.615736 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.615719 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 15:26:17.616015 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.615983 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 15:26:17.616095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.616079 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.616348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.616329 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c9xqk\"" Jul 09 15:26:17.617465 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.617411 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.617550 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.617517 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.617550 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.617534 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 15:26:17.619803 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.619772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.619896 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.619883 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.620010 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.619990 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pg8gs\"" Jul 09 15:26:17.620066 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.620037 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.622100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622083 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rgtrt\"" Jul 09 15:26:17.622155 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622128 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.622379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622363 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.622603 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622584 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:17.622665 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622631 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 15:26:17.622783 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.622766 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.624759 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.624744 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.625185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.625172 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 15:26:17.625463 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.625447 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 15:26:17.625589 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.625577 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 15:26:17.626915 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.626899 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6tnbp\"" Jul 09 15:26:17.626971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.626940 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 15:26:17.626971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.626920 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 15:26:17.627185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.627159 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.627346 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.627234 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 15:26:17.627346 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.627237 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:17.627346 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.627272 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:21:16 +0000 UTC" deadline="2028-01-22 16:40:52.153072003 +0000 UTC" Jul 09 15:26:17.627346 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.627301 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13489h14m34.525772736s" Jul 09 15:26:17.627520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.627366 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lwrs8\"" Jul 09 15:26:17.629560 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.629542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:17.629654 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.629594 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:17.632771 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.632747 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.635475 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.635446 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 15:26:17.635733 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.635715 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ktbh9\"" Jul 09 15:26:17.635777 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.635766 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 15:26:17.640914 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.640898 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:17.650196 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.650176 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8sjqm" Jul 09 15:26:17.658986 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.658961 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8sjqm" Jul 09 15:26:17.706628 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.706603 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 15:26:17.713214 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jd9\" (UniqueName: \"kubernetes.io/projected/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-kube-api-access-t2jd9\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713305 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713236 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-cni-binary-copy\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.713305 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-multus\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.713305 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.713305 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-node-log\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-var-lib-kubelet\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-os-release\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713424 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-system-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prm2b\" (UniqueName: \"kubernetes.io/projected/701d0a50-9308-46ca-bc80-b7eb0a997912-kube-api-access-prm2b\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713459 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-var-lib-kubelet\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713475 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-etc-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-device-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.713545 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-host\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-tuned\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713590 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cnibin\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713608 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-device-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-konnectivity-ca\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-slash\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713691 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-host\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713726 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713755 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-netns\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-bin\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-env-overrides\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713840 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-script-lib\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ec6370b-061a-49f0-8fec-6c4d21693e47-hosts-file\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.713956 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-var-lib-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.713974 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlgxd\" (UniqueName: \"kubernetes.io/projected/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-kube-api-access-wlgxd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-socket-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-sys-fs\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714061 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2765aa5c-e7e9-4443-a96b-579037e9ebed-serviceca\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6nf\" (UniqueName: \"kubernetes.io/projected/2765aa5c-e7e9-4443-a96b-579037e9ebed-kube-api-access-ss6nf\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714130 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-sys-fs\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-systemd-units\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec6370b-061a-49f0-8fec-6c4d21693e47-tmp-dir\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714211 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-system-cni-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-k8s-cni-cncf-io\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714293 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-bin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-multus-certs\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714388 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-kubelet-config\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714417 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9n8w\" (UniqueName: \"kubernetes.io/projected/2ec6370b-061a-49f0-8fec-6c4d21693e47-kube-api-access-n9n8w\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrwts\" (UniqueName: \"kubernetes.io/projected/0711ae0a-af8c-4645-acb9-2623a862c749-kube-api-access-jrwts\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.714703 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-agent-certs\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714478 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-log-socket\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714502 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-conf-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714556 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-etc-kubernetes\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-dbus\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-run\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-tmp\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714652 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-run\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-cnibin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714760 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-kubelet\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc28b495-b19f-4b56-9d67-ee84ef383f9c-host-slash\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2765aa5c-e7e9-4443-a96b-579037e9ebed-host\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovn-node-metrics-cert\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-kubernetes\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714866 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-os-release\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.715578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-socket-dir-parent\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvbx\" (UniqueName: \"kubernetes.io/projected/fc28b495-b19f-4b56-9d67-ee84ef383f9c-kube-api-access-zdvbx\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-netns\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714935 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-kubernetes\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-systemd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-registration-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.714987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-conf\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-systemd\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6pr\" (UniqueName: \"kubernetes.io/projected/a5478fed-b36a-46ec-8007-a17271377208-kube-api-access-bp6pr\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc28b495-b19f-4b56-9d67-ee84ef383f9c-iptables-alerter-script\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715101 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-systemd\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysconfig\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715119 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-registration-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.716467 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715165 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-conf\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715165 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysctl-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715191 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-sysconfig\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vgr\" (UniqueName: \"kubernetes.io/projected/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-kube-api-access-z5vgr\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-hostroot\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-daemon-config\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-etc-selinux\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-modprobe-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-kubelet\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-ovn\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715435 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-etc-selinux\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715441 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-netd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715457 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-modprobe-d\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-sys\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-config\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.717239 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.718098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-lib-modules\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.718098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715568 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-sys\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.718098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0711ae0a-af8c-4645-acb9-2623a862c749-socket-dir\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.718098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.715642 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-lib-modules\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.718098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.716648 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 15:26:17.719551 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.719525 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-tmp\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.719656 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.719549 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-etc-tuned\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.725982 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.725736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jd9\" (UniqueName: \"kubernetes.io/projected/c5dd9da2-c59b-4217-9c5c-21a1d54583bb-kube-api-access-t2jd9\") pod \"tuned-9l8p6\" (UID: \"c5dd9da2-c59b-4217-9c5c-21a1d54583bb\") " pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.726934 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.726911 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrwts\" (UniqueName: \"kubernetes.io/projected/0711ae0a-af8c-4645-acb9-2623a862c749-kube-api-access-jrwts\") pod \"aws-ebs-csi-driver-node-6cf5d\" (UID: \"0711ae0a-af8c-4645-acb9-2623a862c749\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.815889 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.815889 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815890 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-cni-binary-copy\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-multus\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815963 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-node-log\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.815988 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816011 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-os-release\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.816020 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-system-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816057 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prm2b\" (UniqueName: \"kubernetes.io/projected/701d0a50-9308-46ca-bc80-b7eb0a997912-kube-api-access-prm2b\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-node-log\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-etc-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816020 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-multus\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816128 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-etc-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.816134 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:18.316090679 +0000 UTC m=+2.094831490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.816165 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816196 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-system-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.816275 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:18.316255004 +0000 UTC m=+2.094995801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:17.816293 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-os-release\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cnibin\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816342 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-konnectivity-ca\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816379 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cnibin\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-slash\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816427 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-slash\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-netns\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-bin\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-env-overrides\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816550 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-script-lib\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ec6370b-061a-49f0-8fec-6c4d21693e47-hosts-file\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816612 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-netns\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.817223 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-cni-binary-copy\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-var-lib-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816618 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-bin\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlgxd\" (UniqueName: \"kubernetes.io/projected/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-kube-api-access-wlgxd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816667 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ec6370b-061a-49f0-8fec-6c4d21693e47-hosts-file\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2765aa5c-e7e9-4443-a96b-579037e9ebed-serviceca\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-var-lib-openvswitch\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6nf\" (UniqueName: \"kubernetes.io/projected/2765aa5c-e7e9-4443-a96b-579037e9ebed-kube-api-access-ss6nf\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816771 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-systemd-units\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.816796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec6370b-061a-49f0-8fec-6c4d21693e47-tmp-dir\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817002 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-konnectivity-ca\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817054 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-systemd-units\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-system-cni-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817118 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec6370b-061a-49f0-8fec-6c4d21693e47-tmp-dir\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817119 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-k8s-cni-cncf-io\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-bin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817174 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-system-cni-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817162 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-k8s-cni-cncf-io\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.818098 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-multus-certs\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817196 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-cni-bin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-kubelet-config\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817192 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-env-overrides\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817225 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-run-multus-certs\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817257 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-kubelet-config\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817284 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9n8w\" (UniqueName: \"kubernetes.io/projected/2ec6370b-061a-49f0-8fec-6c4d21693e47-kube-api-access-n9n8w\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817284 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-script-lib\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817330 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2765aa5c-e7e9-4443-a96b-579037e9ebed-serviceca\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-agent-certs\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-log-socket\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-conf-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817470 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-etc-kubernetes\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-dbus\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817525 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817550 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-cnibin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817573 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-cni-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819079 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-kubelet\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc28b495-b19f-4b56-9d67-ee84ef383f9c-host-slash\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817651 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2765aa5c-e7e9-4443-a96b-579037e9ebed-host\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817665 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-conf-dir\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovn-node-metrics-cert\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817717 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-etc-kubernetes\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-os-release\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-socket-dir-parent\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817779 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-os-release\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvbx\" (UniqueName: \"kubernetes.io/projected/fc28b495-b19f-4b56-9d67-ee84ef383f9c-kube-api-access-zdvbx\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817820 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-log-socket\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817625 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-kubelet\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817867 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-dbus\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-netns\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc28b495-b19f-4b56-9d67-ee84ef383f9c-host-slash\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-run-netns\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.817990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-systemd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.819828 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-systemd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6pr\" (UniqueName: \"kubernetes.io/projected/a5478fed-b36a-46ec-8007-a17271377208-kube-api-access-bp6pr\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818134 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc28b495-b19f-4b56-9d67-ee84ef383f9c-iptables-alerter-script\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2765aa5c-e7e9-4443-a96b-579037e9ebed-host\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818237 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-cnibin\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818286 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-socket-dir-parent\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818409 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vgr\" (UniqueName: \"kubernetes.io/projected/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-kube-api-access-z5vgr\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818651 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-hostroot\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818654 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-daemon-config\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-kubelet\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-ovn\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-netd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818811 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-config\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818909 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-host-var-lib-kubelet\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818931 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/701d0a50-9308-46ca-bc80-b7eb0a997912-hostroot\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818934 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-host-cni-netd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.818972 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-run-ovn\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.819179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc28b495-b19f-4b56-9d67-ee84ef383f9c-iptables-alerter-script\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.819393 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.819467 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/701d0a50-9308-46ca-bc80-b7eb0a997912-multus-daemon-config\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.819486 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovnkube-config\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.820979 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.820457 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f509e9c8-f91f-45eb-a1ef-4b4dce199bd4-agent-certs\") pod \"konnectivity-agent-pgmkv\" (UID: \"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4\") " pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:17.821606 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.821589 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-ovn-node-metrics-cert\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.824684 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.824659 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:17.824684 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.824683 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:17.824829 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.824695 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:17.824829 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:17.824741 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:18.324727448 +0000 UTC m=+2.103468238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:17.826780 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.826753 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prm2b\" (UniqueName: \"kubernetes.io/projected/701d0a50-9308-46ca-bc80-b7eb0a997912-kube-api-access-prm2b\") pod \"multus-nlj5c\" (UID: \"701d0a50-9308-46ca-bc80-b7eb0a997912\") " pod="openshift-multus/multus-nlj5c" Jul 09 15:26:17.828070 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.828026 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9n8w\" (UniqueName: \"kubernetes.io/projected/2ec6370b-061a-49f0-8fec-6c4d21693e47-kube-api-access-n9n8w\") pod \"node-resolver-nflcx\" (UID: \"2ec6370b-061a-49f0-8fec-6c4d21693e47\") " pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:17.828517 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.828491 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlgxd\" (UniqueName: \"kubernetes.io/projected/c36c65a4-41d8-4c61-8c45-8c0d797c3b1f-kube-api-access-wlgxd\") pod \"ovnkube-node-q9v9p\" (UID: \"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:17.828609 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.828539 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvbx\" (UniqueName: \"kubernetes.io/projected/fc28b495-b19f-4b56-9d67-ee84ef383f9c-kube-api-access-zdvbx\") pod \"iptables-alerter-k6t4j\" (UID: \"fc28b495-b19f-4b56-9d67-ee84ef383f9c\") " pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.829059 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.829030 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6pr\" (UniqueName: \"kubernetes.io/projected/a5478fed-b36a-46ec-8007-a17271377208-kube-api-access-bp6pr\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:17.829622 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.829599 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6nf\" (UniqueName: \"kubernetes.io/projected/2765aa5c-e7e9-4443-a96b-579037e9ebed-kube-api-access-ss6nf\") pod \"node-ca-b2zl9\" (UID: \"2765aa5c-e7e9-4443-a96b-579037e9ebed\") " pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:17.830407 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.830390 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vgr\" (UniqueName: \"kubernetes.io/projected/c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd-kube-api-access-z5vgr\") pod \"multus-additional-cni-plugins-f5w46\" (UID: \"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd\") " pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:17.897954 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:17.897909 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaa49bed4f018674f19ee2e2bb3d341.slice/crio-021ab3410b58cf247dfdb0174d05d404d22c46fb2a1dc9d1aadc9efed3ed8e48 WatchSource:0}: Error finding container 021ab3410b58cf247dfdb0174d05d404d22c46fb2a1dc9d1aadc9efed3ed8e48: Status 404 returned error can't find the container with id 021ab3410b58cf247dfdb0174d05d404d22c46fb2a1dc9d1aadc9efed3ed8e48 Jul 09 15:26:17.905013 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.904994 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:26:17.910837 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:17.910810 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5d0c8fd52f7be4f7ee3a0e3f7fbf93.slice/crio-7291ea48e55cd0c409a6c64774f118ba39107a8603cbad345591c139e27d7fb6 WatchSource:0}: Error finding container 7291ea48e55cd0c409a6c64774f118ba39107a8603cbad345591c139e27d7fb6: Status 404 returned error can't find the container with id 7291ea48e55cd0c409a6c64774f118ba39107a8603cbad345591c139e27d7fb6 Jul 09 15:26:17.933200 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.933122 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" Jul 09 15:26:17.940740 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.940718 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" Jul 09 15:26:17.942721 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:17.942696 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0711ae0a_af8c_4645_acb9_2623a862c749.slice/crio-44bae742fd57cfb2346a28e7de8651353ec7fa41ca6ec2f21e72506c0018528b WatchSource:0}: Error finding container 44bae742fd57cfb2346a28e7de8651353ec7fa41ca6ec2f21e72506c0018528b: Status 404 returned error can't find the container with id 44bae742fd57cfb2346a28e7de8651353ec7fa41ca6ec2f21e72506c0018528b Jul 09 15:26:17.949836 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:17.949813 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5dd9da2_c59b_4217_9c5c_21a1d54583bb.slice/crio-b464eee09b1fc4c566c974aaa50dfef417d626331781a0566c1c89be4db44ed2 WatchSource:0}: Error finding container b464eee09b1fc4c566c974aaa50dfef417d626331781a0566c1c89be4db44ed2: Status 404 returned error can't find the container with id b464eee09b1fc4c566c974aaa50dfef417d626331781a0566c1c89be4db44ed2 Jul 09 15:26:17.962220 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.962191 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k6t4j" Jul 09 15:26:17.972479 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:17.972438 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc28b495_b19f_4b56_9d67_ee84ef383f9c.slice/crio-d9d23964d33ffc13e6de321e1906c0b4d963950da21fe8acae9a1c6c729ca91b WatchSource:0}: Error finding container d9d23964d33ffc13e6de321e1906c0b4d963950da21fe8acae9a1c6c729ca91b: Status 404 returned error can't find the container with id d9d23964d33ffc13e6de321e1906c0b4d963950da21fe8acae9a1c6c729ca91b Jul 09 15:26:17.996536 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:17.996496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:18.006680 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.006646 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36c65a4_41d8_4c61_8c45_8c0d797c3b1f.slice/crio-2c72c2b1418066c359dea65162a40ce71fb20bdadff1b4c976ebc77a06e81819 WatchSource:0}: Error finding container 2c72c2b1418066c359dea65162a40ce71fb20bdadff1b4c976ebc77a06e81819: Status 404 returned error can't find the container with id 2c72c2b1418066c359dea65162a40ce71fb20bdadff1b4c976ebc77a06e81819 Jul 09 15:26:18.016164 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.016142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nflcx" Jul 09 15:26:18.025919 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.025893 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec6370b_061a_49f0_8fec_6c4d21693e47.slice/crio-379a8b5de5bc5037165edc36bd2de38db1c81996071a1cd58b73762bed722373 WatchSource:0}: Error finding container 379a8b5de5bc5037165edc36bd2de38db1c81996071a1cd58b73762bed722373: Status 404 returned error can't find the container with id 379a8b5de5bc5037165edc36bd2de38db1c81996071a1cd58b73762bed722373 Jul 09 15:26:18.038481 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.038453 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2zl9" Jul 09 15:26:18.048017 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.047989 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2765aa5c_e7e9_4443_a96b_579037e9ebed.slice/crio-e1f036f1e23195f28fc97b17edfd60dd43ce8323193652707de03b8c111d37cb WatchSource:0}: Error finding container e1f036f1e23195f28fc97b17edfd60dd43ce8323193652707de03b8c111d37cb: Status 404 returned error can't find the container with id e1f036f1e23195f28fc97b17edfd60dd43ce8323193652707de03b8c111d37cb Jul 09 15:26:18.057959 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.057937 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f5w46" Jul 09 15:26:18.068652 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.068620 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07131eb_5ea7_4cb7_a584_5c9e6e09e9bd.slice/crio-5f59b3f8576a9f957c355ad6f3c9687c9d160fb947f28f2fa7aa6ea654b4a8ca WatchSource:0}: Error finding container 5f59b3f8576a9f957c355ad6f3c9687c9d160fb947f28f2fa7aa6ea654b4a8ca: Status 404 returned error can't find the container with id 5f59b3f8576a9f957c355ad6f3c9687c9d160fb947f28f2fa7aa6ea654b4a8ca Jul 09 15:26:18.073211 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.073159 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlj5c" Jul 09 15:26:18.078104 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.078081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:18.083088 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.083056 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701d0a50_9308_46ca_bc80_b7eb0a997912.slice/crio-6af8eae9c15839475db3cdeeacbecc82fd578bf97a130d572bf58ab171e45a8a WatchSource:0}: Error finding container 6af8eae9c15839475db3cdeeacbecc82fd578bf97a130d572bf58ab171e45a8a: Status 404 returned error can't find the container with id 6af8eae9c15839475db3cdeeacbecc82fd578bf97a130d572bf58ab171e45a8a Jul 09 15:26:18.087982 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:18.087951 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf509e9c8_f91f_45eb_a1ef_4b4dce199bd4.slice/crio-bcbfaa8de0d0b367cf35d735bacce84cf776227a4c3538878c68db0c8b0cca70 WatchSource:0}: Error finding container bcbfaa8de0d0b367cf35d735bacce84cf776227a4c3538878c68db0c8b0cca70: Status 404 returned error can't find the container with id bcbfaa8de0d0b367cf35d735bacce84cf776227a4c3538878c68db0c8b0cca70 Jul 09 15:26:18.089793 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.089768 2557 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-pgmkv_kube-system(f509e9c8-f91f-45eb-a1ef-4b4dce199bd4): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 09 15:26:18.089864 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.089805 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-pgmkv" podUID="f509e9c8-f91f-45eb-a1ef-4b4dce199bd4" Jul 09 15:26:18.198306 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.198176 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:18.322952 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.322911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:18.323143 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.322981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:18.323143 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.323072 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:18.323143 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.323126 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:18.323143 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.323144 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:19.323126323 +0000 UTC m=+3.101867116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:18.323412 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.323184 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:19.323166228 +0000 UTC m=+3.101907024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:18.424355 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.424316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:18.424620 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.424597 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:18.424718 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.424628 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:18.424718 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.424642 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:18.424718 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.424708 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:19.424686844 +0000 UTC m=+3.203427634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:18.662876 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.662804 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:17 +0000 UTC" deadline="2027-12-30 01:10:28.247405733 +0000 UTC" Jul 09 15:26:18.662876 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.662875 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12921h44m9.584535164s" Jul 09 15:26:18.841903 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.841835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nflcx" event={"ID":"2ec6370b-061a-49f0-8fec-6c4d21693e47","Type":"ContainerStarted","Data":"379a8b5de5bc5037165edc36bd2de38db1c81996071a1cd58b73762bed722373"} Jul 09 15:26:18.860871 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.860827 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"2c72c2b1418066c359dea65162a40ce71fb20bdadff1b4c976ebc77a06e81819"} Jul 09 15:26:18.865518 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.865476 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k6t4j" event={"ID":"fc28b495-b19f-4b56-9d67-ee84ef383f9c","Type":"ContainerStarted","Data":"d9d23964d33ffc13e6de321e1906c0b4d963950da21fe8acae9a1c6c729ca91b"} Jul 09 15:26:18.901114 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.900994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" event={"ID":"c5dd9da2-c59b-4217-9c5c-21a1d54583bb","Type":"ContainerStarted","Data":"b464eee09b1fc4c566c974aaa50dfef417d626331781a0566c1c89be4db44ed2"} Jul 09 15:26:18.906694 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.906575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" event={"ID":"0711ae0a-af8c-4645-acb9-2623a862c749","Type":"ContainerStarted","Data":"44bae742fd57cfb2346a28e7de8651353ec7fa41ca6ec2f21e72506c0018528b"} Jul 09 15:26:18.928367 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.928254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerStarted","Data":"7291ea48e55cd0c409a6c64774f118ba39107a8603cbad345591c139e27d7fb6"} Jul 09 15:26:18.944134 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.944031 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" event={"ID":"dfaa49bed4f018674f19ee2e2bb3d341","Type":"ContainerStarted","Data":"021ab3410b58cf247dfdb0174d05d404d22c46fb2a1dc9d1aadc9efed3ed8e48"} Jul 09 15:26:18.968518 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.967742 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgmkv" event={"ID":"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4","Type":"ContainerStarted","Data":"bcbfaa8de0d0b367cf35d735bacce84cf776227a4c3538878c68db0c8b0cca70"} Jul 09 15:26:18.982815 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:18.982531 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f30e2d772ad51a8be4fab0f25ba0e636853b7f3cb2f1f87cc3a0b192d3fda47a\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-pgmkv" podUID="f509e9c8-f91f-45eb-a1ef-4b4dce199bd4" Jul 09 15:26:18.997391 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:18.997349 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlj5c" event={"ID":"701d0a50-9308-46ca-bc80-b7eb0a997912","Type":"ContainerStarted","Data":"6af8eae9c15839475db3cdeeacbecc82fd578bf97a130d572bf58ab171e45a8a"} Jul 09 15:26:19.023534 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.023490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerStarted","Data":"5f59b3f8576a9f957c355ad6f3c9687c9d160fb947f28f2fa7aa6ea654b4a8ca"} Jul 09 15:26:19.036873 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.036826 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2zl9" event={"ID":"2765aa5c-e7e9-4443-a96b-579037e9ebed","Type":"ContainerStarted","Data":"e1f036f1e23195f28fc97b17edfd60dd43ce8323193652707de03b8c111d37cb"} Jul 09 15:26:19.084735 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.084698 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.332148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.332206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.332391 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.332463 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.332441744 +0000 UTC m=+5.111182575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.332887 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:19.333016 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.332968 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.332925293 +0000 UTC m=+5.111666101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:19.432701 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.432658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:19.432910 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.432827 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:19.432910 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.432848 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:19.432910 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.432862 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:19.433088 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.432930 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.432911506 +0000 UTC m=+5.211652301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:19.663403 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.663255 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:17 +0000 UTC" deadline="2028-01-16 04:27:02.740491448 +0000 UTC" Jul 09 15:26:19.663403 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.663302 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13333h0m43.077195645s" Jul 09 15:26:19.789155 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.789116 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:19.789385 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.789289 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:19.789484 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.789411 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:19.789541 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.789506 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:19.789601 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.789568 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:19.789927 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:19.789655 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:19.916589 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:19.916487 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:21.350751 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.350699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:21.350751 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.350752 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:21.351263 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.350886 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.351263 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.350958 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:25.350935448 +0000 UTC m=+9.129676257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.351397 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.351364 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.351527 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.351419 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:25.351402692 +0000 UTC m=+9.130143502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.452398 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.451797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:21.452398 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.451951 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:21.452398 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.451972 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:21.452398 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.451985 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.452398 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.452042 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:25.452022971 +0000 UTC m=+9.230763766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.788944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.789078 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.789447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.789543 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:21.789592 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:21.789752 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:21.789699 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:23.789404 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:23.789368 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:23.789958 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:23.789492 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:23.789958 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:23.789887 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:23.790089 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:23.789981 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:23.790089 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:23.790040 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:23.790158 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:23.790092 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:25.387927 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.387884 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:25.388345 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.387936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:25.388345 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.388032 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:25.388345 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.388079 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:33.388064427 +0000 UTC m=+17.166805215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:25.388512 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.388435 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:25.388512 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.388481 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:33.388467492 +0000 UTC m=+17.167208285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:25.488523 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.488479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:25.488691 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.488672 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:25.488746 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.488693 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:25.488746 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.488704 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:25.488831 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.488754 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:33.488736467 +0000 UTC m=+17.267477270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:25.788796 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.788765 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:25.788982 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.788819 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:25.788982 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:25.788760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:25.788982 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.788908 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:25.789151 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.789037 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:25.789151 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:25.789136 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:27.789568 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:27.789528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:27.790009 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:27.789680 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:27.790105 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:27.790081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:27.790191 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:27.790173 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:27.790261 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:27.790229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:27.790344 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:27.790328 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:29.789046 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:29.789006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:29.789046 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:29.789030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:29.789562 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:29.789055 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:29.789562 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:29.789160 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:29.789562 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:29.789303 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:29.789562 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:29.789375 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:31.789477 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:31.789437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:31.789477 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:31.789468 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:31.789893 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:31.789437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:31.789893 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:31.789565 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:31.789893 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:31.789632 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:31.789893 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:31.789696 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:33.444738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.444695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:33.444738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.444738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:33.445279 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.444839 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:33.445279 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.444841 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:33.445279 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.444895 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:49.444880403 +0000 UTC m=+33.223621191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:33.445279 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.444909 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:49.444902673 +0000 UTC m=+33.223643461 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:33.545354 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.545317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:33.545519 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.545496 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:33.545562 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.545526 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:33.545562 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.545537 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:33.545623 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.545594 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:49.545578019 +0000 UTC m=+33.324318823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:33.788870 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.788835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:33.789014 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.788835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:33.789014 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.788944 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:33.789118 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:33.788835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:33.789118 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.789030 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:33.789118 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:33.789090 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:35.789589 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:35.789553 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:35.790039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:35.789554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:35.790039 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:35.789677 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:35.790039 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:35.789783 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:35.790039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:35.789553 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:35.790039 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:35.789930 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:37.789645 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:37.789606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:37.790049 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:37.789648 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:37.790049 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:37.789650 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:37.790049 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:37.789728 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:37.790049 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:37.789781 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:37.790049 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:37.789875 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:39.083730 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.083279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nflcx" event={"ID":"2ec6370b-061a-49f0-8fec-6c4d21693e47","Type":"ContainerStarted","Data":"236161ad3e8d8212de56c13d0ba1ed2465398671fb992675b43c33db23e0d522"} Jul 09 15:26:39.086605 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.086576 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"247b7657c82de871f365387df3604f7070bf489df32f54735ae6155623b623fd"} Jul 09 15:26:39.086729 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.086667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"53e011aa7d470b7325963f0f25dc7397d834ccb817bd17fb03f6440473a4d1fd"} Jul 09 15:26:39.086729 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.086719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"9b0dbea2d083c4ae078c58694422b51cc8e4b48c5a2cc79d57b06cf64f5c276c"} Jul 09 15:26:39.086827 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.086767 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"dde5e122c2c857df679a36588c089995cee26d74a25b998a0cffa463a2f91db6"} Jul 09 15:26:39.086827 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.086809 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"b50e81ead0d2ca16a21a81bcb4c25bae88826c2c916461d0a2e9a45ea177fa0b"} Jul 09 15:26:39.088222 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.088196 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" event={"ID":"c5dd9da2-c59b-4217-9c5c-21a1d54583bb","Type":"ContainerStarted","Data":"1df110b7ee95b99b5d94c51caae0c0407f411ae57f64c6681858295402ce3d9d"} Jul 09 15:26:39.089789 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.089761 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" event={"ID":"0711ae0a-af8c-4645-acb9-2623a862c749","Type":"ContainerStarted","Data":"3ced17ce6ef134988f8560328393af3b1298518fdda9362bb3d70ee8d5f56d24"} Jul 09 15:26:39.091412 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.091385 2557 generic.go:356] "Generic (PLEG): container finished" podID="3e5d0c8fd52f7be4f7ee3a0e3f7fbf93" containerID="4327b524c23eabf12515e446f7b2b3aad54555be4a4e8e29b9dfa4358258bb83" exitCode=0 Jul 09 15:26:39.091504 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.091466 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerDied","Data":"4327b524c23eabf12515e446f7b2b3aad54555be4a4e8e29b9dfa4358258bb83"} Jul 09 15:26:39.092986 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.092958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" event={"ID":"dfaa49bed4f018674f19ee2e2bb3d341","Type":"ContainerStarted","Data":"505a0aec06965b63e02f72a318b0c76c94a01a6e32c6604b24b1b7252d2c2242"} Jul 09 15:26:39.094591 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.094570 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlj5c" event={"ID":"701d0a50-9308-46ca-bc80-b7eb0a997912","Type":"ContainerStarted","Data":"80a19787791f372658e92a736005fef86b09a62c0b5d7cd6319ed1d6ec557ba2"} Jul 09 15:26:39.096302 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.096275 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="afd788ef57cda4c128eab54ba39b6150ea8d964d7b4da7064925244e0c15b94f" exitCode=0 Jul 09 15:26:39.096409 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.096362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"afd788ef57cda4c128eab54ba39b6150ea8d964d7b4da7064925244e0c15b94f"} Jul 09 15:26:39.098090 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.098068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2zl9" event={"ID":"2765aa5c-e7e9-4443-a96b-579037e9ebed","Type":"ContainerStarted","Data":"570037ae099376d4b4ab2a159db32b4eff47a8db913d61cf6a20a15cdcb420ce"} Jul 09 15:26:39.122729 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.122658 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nflcx" podStartSLOduration=2.089197381 podStartE2EDuration="22.122636632s" totalImagesPullingTime="20.033439251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:39.100562607 +0000 UTC m=+22.879303418" watchObservedRunningTime="2026-07-09 15:26:39.122636632 +0000 UTC m=+22.901377442" Jul 09 15:26:39.140082 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.140010 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2zl9" podStartSLOduration=2.144908818 podStartE2EDuration="22.139990877s" totalImagesPullingTime="19.995082059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:39.122849458 +0000 UTC m=+22.901590269" watchObservedRunningTime="2026-07-09 15:26:39.139990877 +0000 UTC m=+22.918731744" Jul 09 15:26:39.163367 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.163317 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" podStartSLOduration=22.163301341 podStartE2EDuration="22.163301341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:39.140329176 +0000 UTC m=+22.919069988" watchObservedRunningTime="2026-07-09 15:26:39.163301341 +0000 UTC m=+22.942042150" Jul 09 15:26:39.163508 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.163432 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9l8p6" podStartSLOduration=2.070256653 podStartE2EDuration="22.163428651s" totalImagesPullingTime="20.093171998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:39.163013796 +0000 UTC m=+22.941754606" watchObservedRunningTime="2026-07-09 15:26:39.163428651 +0000 UTC m=+22.942169461" Jul 09 15:26:39.219643 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.219594 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nlj5c" podStartSLOduration=2.205422832 podStartE2EDuration="22.219580393s" totalImagesPullingTime="20.014157561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:39.219226747 +0000 UTC m=+22.997967557" watchObservedRunningTime="2026-07-09 15:26:39.219580393 +0000 UTC m=+22.998321204" Jul 09 15:26:39.789371 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.789336 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:39.789371 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.789369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:39.789615 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:39.789347 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:39.789615 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:39.789476 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:39.789615 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:39.789582 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:39.789758 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:39.789668 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:40.102922 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.102882 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerStarted","Data":"3b63996313c99aeb8bd4587f4007d07fee65dee3a2fa5b79e6cf19f1157feda6"} Jul 09 15:26:40.104729 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.104701 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgmkv" event={"ID":"f509e9c8-f91f-45eb-a1ef-4b4dce199bd4","Type":"ContainerStarted","Data":"3c15ce8c9cbf1c5b24480fdcfe2a29bd532f93600193b5598a6db86e8f22114d"} Jul 09 15:26:40.108213 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.108185 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"2cc259ead81e8941006cf325a86590dbb2878c1dbd7710ba93a39a27d0014e13"} Jul 09 15:26:40.109992 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.109967 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k6t4j" event={"ID":"fc28b495-b19f-4b56-9d67-ee84ef383f9c","Type":"ContainerStarted","Data":"2330493da1f49a0d3942a663eb05dda6ea01fde8ba87cd65f1b6140c60360bca"} Jul 09 15:26:40.121622 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.121538 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" podStartSLOduration=23.121517331 podStartE2EDuration="23.121517331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.12145661 +0000 UTC m=+23.900197420" watchObservedRunningTime="2026-07-09 15:26:40.121517331 +0000 UTC m=+23.900258142" Jul 09 15:26:40.138537 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.138489 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k6t4j" podStartSLOduration=3.067938889 podStartE2EDuration="23.13847227s" totalImagesPullingTime="20.070533381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.137937342 +0000 UTC m=+23.916678152" watchObservedRunningTime="2026-07-09 15:26:40.13847227 +0000 UTC m=+23.917213079" Jul 09 15:26:40.386353 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.386169 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 15:26:40.686401 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.686226 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T15:26:40.38634726Z","UUID":"69d23edd-9496-4ea1-bfcf-7f5a9ee73527","Handler":null,"Name":"","Endpoint":""} Jul 09 15:26:40.687728 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.687705 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 15:26:40.687907 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:40.687751 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 15:26:41.114848 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:41.114810 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" event={"ID":"0711ae0a-af8c-4645-acb9-2623a862c749","Type":"ContainerStarted","Data":"48336080ad0a52c036abd4700fb627a4d8fc47ba086aba82e8584364371976ab"} Jul 09 15:26:41.789216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:41.789177 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:41.789411 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:41.789219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:41.789411 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:41.789226 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:41.789411 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:41.789335 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:41.789585 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:41.789434 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:41.789585 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:41.789526 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:42.120977 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:42.120930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"943d167cef2e2fdfba71e2756c48c0dac757ded9b387e1828783ab1303c07a5d"} Jul 09 15:26:43.422585 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.422557 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:43.423109 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.423069 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:43.439387 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.439341 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pgmkv" podStartSLOduration=5.020253266 podStartE2EDuration="26.439323496s" totalImagesPullingTime="21.41907023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 15:26:40.15452911 +0000 UTC m=+23.933269921" watchObservedRunningTime="2026-07-09 15:26:43.439323496 +0000 UTC m=+27.218064307" Jul 09 15:26:43.789221 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.788867 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:43.789221 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.788866 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:43.789348 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:43.789218 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:43.789348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:43.788893 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:43.789348 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:43.789268 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:43.789456 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:43.789346 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:44.127262 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.127128 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" event={"ID":"0711ae0a-af8c-4645-acb9-2623a862c749","Type":"ContainerStarted","Data":"3372cce466106c0d23a99585df94ec2786a55cf836fa4e59199112c236af8451"} Jul 09 15:26:44.129057 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.129033 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="8b3dafb49b1dbffdc74d8e440ed59668a7bb34e968769a852320ae9b3ca69bfb" exitCode=0 Jul 09 15:26:44.129194 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.129125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"8b3dafb49b1dbffdc74d8e440ed59668a7bb34e968769a852320ae9b3ca69bfb"} Jul 09 15:26:44.133208 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.133180 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" event={"ID":"c36c65a4-41d8-4c61-8c45-8c0d797c3b1f","Type":"ContainerStarted","Data":"0ac815940ab9d6870420fe9a080e5f9dda1b01005417332b5b30102f41c00d31"} Jul 09 15:26:44.133423 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.133399 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:44.133492 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.133445 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:44.133784 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.133768 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pgmkv" Jul 09 15:26:44.149417 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.149372 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6cf5d" podStartSLOduration=4.060928893 podStartE2EDuration="27.149356534s" totalImagesPullingTime="23.088427641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:44.149324315 +0000 UTC m=+27.928065124" watchObservedRunningTime="2026-07-09 15:26:44.149356534 +0000 UTC m=+27.928097343" Jul 09 15:26:44.223064 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:44.223007 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" podStartSLOduration=7.103094332 podStartE2EDuration="27.222988976s" totalImagesPullingTime="20.119894644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:44.222886109 +0000 UTC m=+28.001626918" watchObservedRunningTime="2026-07-09 15:26:44.222988976 +0000 UTC m=+28.001729785" Jul 09 15:26:45.135765 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.135733 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:45.136274 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.135819 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:45.152262 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.152219 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:45.152408 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.152346 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:26:45.752541 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.752257 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8sb66"] Jul 09 15:26:45.752795 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.752620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:45.752795 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:45.752750 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:45.753174 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.753146 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25mk8"] Jul 09 15:26:45.753296 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.753280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:45.753392 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:45.753370 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:45.758294 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.758266 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpfd6"] Jul 09 15:26:45.758415 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:45.758382 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:45.758514 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:45.758495 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:46.141302 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:46.141261 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="f97f775660931fcea717ab0ae91cea57d39a3454122a825347afd1dd0fc65b98" exitCode=0 Jul 09 15:26:46.141302 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:46.141278 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"f97f775660931fcea717ab0ae91cea57d39a3454122a825347afd1dd0fc65b98"} Jul 09 15:26:47.789289 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:47.789226 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:47.789806 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:47.789294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:47.789806 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:47.789308 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:47.789806 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:47.789387 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:47.789806 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:47.789510 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:47.789806 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:47.789584 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:48.148387 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:48.148164 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="4d002876c1c54ea6f49e0602ce0c1e23bea36f6c584c9f143e0c733f4be84927" exitCode=0 Jul 09 15:26:48.148387 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:48.148207 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"4d002876c1c54ea6f49e0602ce0c1e23bea36f6c584c9f143e0c733f4be84927"} Jul 09 15:26:49.467146 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.466896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:49.467146 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.467110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:49.467719 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.467187 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:49.467719 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.467219 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:49.467719 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.467296 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:21.467274976 +0000 UTC m=+65.246015785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:49.467719 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.467312 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret podName:932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:21.467306018 +0000 UTC m=+65.246046806 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret") pod "global-pull-secret-syncer-25mk8" (UID: "932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:49.568294 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.568250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:49.568484 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.568430 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:49.568484 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.568454 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:49.568484 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.568470 2557 projected.go:196] Error preparing data for projected volume kube-api-access-bcw8h for pod openshift-network-diagnostics/network-check-target-fpfd6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:49.568608 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.568530 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h podName:9f64724a-3d0f-4884-a141-b00744e85199 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:21.568511062 +0000 UTC m=+65.347251861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bcw8h" (UniqueName: "kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h") pod "network-check-target-fpfd6" (UID: "9f64724a-3d0f-4884-a141-b00744e85199") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:49.789529 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.789490 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:49.789529 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.789530 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:49.789763 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:49.789537 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:49.789763 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.789625 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:49.789865 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.789788 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:49.789919 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:49.789890 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:51.789558 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:51.789517 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:51.789558 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:51.789543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:51.790060 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:51.789529 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:51.790060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:51.789658 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:26:51.790060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:51.789755 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25mk8" podUID="932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4" Jul 09 15:26:51.790060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:51.789847 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpfd6" podUID="9f64724a-3d0f-4884-a141-b00744e85199" Jul 09 15:26:52.075996 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.075963 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeReady" Jul 09 15:26:52.076187 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.076121 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 15:26:52.127531 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.127501 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6kgcn"] Jul 09 15:26:52.159352 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.159320 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9dcfs"] Jul 09 15:26:52.159534 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.159461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.163202 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.163174 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 15:26:52.163367 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.163320 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4b26\"" Jul 09 15:26:52.163540 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.163527 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 15:26:52.173475 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.173440 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9dcfs"] Jul 09 15:26:52.173608 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.173484 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6kgcn"] Jul 09 15:26:52.173608 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.173565 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.176339 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.176312 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 15:26:52.176443 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.176358 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 15:26:52.176443 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.176370 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5snc7\"" Jul 09 15:26:52.176443 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.176314 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 15:26:52.290700 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-tmp-dir\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.290862 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290734 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d850e-c7ed-4014-87ab-c132b2bf7900-cert\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.290862 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290750 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-config-volume\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.290862 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.290862 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph2d9\" (UniqueName: \"kubernetes.io/projected/340d850e-c7ed-4014-87ab-c132b2bf7900-kube-api-access-ph2d9\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.290862 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.290840 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmm4\" (UniqueName: \"kubernetes.io/projected/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-kube-api-access-hmmm4\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392000 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.391911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d850e-c7ed-4014-87ab-c132b2bf7900-cert\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.392000 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.391951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-config-volume\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392000 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.391969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392290 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.392015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph2d9\" (UniqueName: \"kubernetes.io/projected/340d850e-c7ed-4014-87ab-c132b2bf7900-kube-api-access-ph2d9\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.392290 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.392047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmm4\" (UniqueName: \"kubernetes.io/projected/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-kube-api-access-hmmm4\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392290 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.392078 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-tmp-dir\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392290 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:52.392089 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:52.392290 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:52.392156 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:52.892137773 +0000 UTC m=+36.670878580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:26:52.392475 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.392405 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-tmp-dir\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.392566 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.392543 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-config-volume\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.396137 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.396115 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d850e-c7ed-4014-87ab-c132b2bf7900-cert\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.403812 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.403785 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmm4\" (UniqueName: \"kubernetes.io/projected/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-kube-api-access-hmmm4\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.404069 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.404050 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph2d9\" (UniqueName: \"kubernetes.io/projected/340d850e-c7ed-4014-87ab-c132b2bf7900-kube-api-access-ph2d9\") pod \"ingress-canary-9dcfs\" (UID: \"340d850e-c7ed-4014-87ab-c132b2bf7900\") " pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.484050 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.484014 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9dcfs" Jul 09 15:26:52.793311 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.793111 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9dcfs"] Jul 09 15:26:52.797555 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:26:52.797521 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340d850e_c7ed_4014_87ab_c132b2bf7900.slice/crio-2713ad212225c079bfe48fbcaf020f6eb0da23da2e896d565c25300a87e73bdd WatchSource:0}: Error finding container 2713ad212225c079bfe48fbcaf020f6eb0da23da2e896d565c25300a87e73bdd: Status 404 returned error can't find the container with id 2713ad212225c079bfe48fbcaf020f6eb0da23da2e896d565c25300a87e73bdd Jul 09 15:26:52.896389 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:52.896349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:52.896557 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:52.896503 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:52.896604 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:52.896574 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:53.89655554 +0000 UTC m=+37.675296327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:26:53.164504 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.164472 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="a2e88a77ac8de9502051a746c540648a66add8b07563ee657370f0cb8a8cdbc7" exitCode=0 Jul 09 15:26:53.164685 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.164554 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"a2e88a77ac8de9502051a746c540648a66add8b07563ee657370f0cb8a8cdbc7"} Jul 09 15:26:53.165752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.165730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9dcfs" event={"ID":"340d850e-c7ed-4014-87ab-c132b2bf7900","Type":"ContainerStarted","Data":"2713ad212225c079bfe48fbcaf020f6eb0da23da2e896d565c25300a87e73bdd"} Jul 09 15:26:53.789183 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.789147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:26:53.789394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.789207 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:26:53.789394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.789147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:26:53.792437 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.792412 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb7pf\"" Jul 09 15:26:53.793505 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.793483 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:26:53.793505 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.793493 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:26:53.794100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.793590 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:26:53.794100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.793493 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:26:53.794100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.793729 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ttrzf\"" Jul 09 15:26:53.902848 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:53.902811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:53.903038 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:53.902943 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:53.903038 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:53.903005 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:55.902986768 +0000 UTC m=+39.681727560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:26:54.172023 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:54.171928 2557 generic.go:356] "Generic (PLEG): container finished" podID="c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd" containerID="279222bfb614462301fd2d3819fc81174885e65af4f5111a87ce77ebd7d3faa3" exitCode=0 Jul 09 15:26:54.172023 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:54.171987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerDied","Data":"279222bfb614462301fd2d3819fc81174885e65af4f5111a87ce77ebd7d3faa3"} Jul 09 15:26:55.178991 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:55.178948 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5w46" event={"ID":"c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd","Type":"ContainerStarted","Data":"83a7a3d82a27558e03036c8adaf25e6b94f71d33c18b5c11228433a3d637ab0d"} Jul 09 15:26:55.211138 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:55.211074 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f5w46" podStartSLOduration=7.358134718 podStartE2EDuration="38.211053914s" totalImagesPullingTime="30.852919196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:55.210667288 +0000 UTC m=+38.989408124" watchObservedRunningTime="2026-07-09 15:26:55.211053914 +0000 UTC m=+38.989794724" Jul 09 15:26:55.919784 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:55.919586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:55.919963 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:55.919757 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:55.919963 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:55.919861 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:59.919846664 +0000 UTC m=+43.698587451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:26:56.182466 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:56.182367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9dcfs" event={"ID":"340d850e-c7ed-4014-87ab-c132b2bf7900","Type":"ContainerStarted","Data":"437c5e30c2921615faea085f456f54cf5ecccb24686907eee3f55045a874908e"} Jul 09 15:26:56.206733 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:56.206683 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9dcfs" podStartSLOduration=1.727592981 podStartE2EDuration="4.206663739s" totalImagesPullingTime="2.479070758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:56.205539022 +0000 UTC m=+39.984279831" watchObservedRunningTime="2026-07-09 15:26:56.206663739 +0000 UTC m=+39.985404548" Jul 09 15:26:59.949635 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:26:59.949589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:26:59.950031 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:59.949708 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:59.950031 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:26:59.949760 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:07.949747863 +0000 UTC m=+51.728488650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:27:08.009483 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:08.009429 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:27:08.009944 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:08.009558 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:08.009944 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:08.009612 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.009597602 +0000 UTC m=+67.788338391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:27:17.153759 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:17.153728 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9v9p" Jul 09 15:27:21.509944 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.509901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:27:21.509944 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.509951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:27:21.512737 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.512715 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:27:21.512860 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.512718 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:27:21.520204 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:21.520187 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:27:21.520288 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:21.520257 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:28:25.520224276 +0000 UTC m=+129.298965064 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : secret "metrics-daemon-secret" not found Jul 09 15:27:21.523597 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.523581 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4-original-pull-secret\") pod \"global-pull-secret-syncer-25mk8\" (UID: \"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4\") " pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:27:21.610395 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.610348 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:27:21.613401 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.613385 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:27:21.623511 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.623493 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:27:21.634426 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.634405 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcw8h\" (UniqueName: \"kubernetes.io/projected/9f64724a-3d0f-4884-a141-b00744e85199-kube-api-access-bcw8h\") pod \"network-check-target-fpfd6\" (UID: \"9f64724a-3d0f-4884-a141-b00744e85199\") " pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:27:21.706063 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.706028 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ttrzf\"" Jul 09 15:27:21.709821 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.709804 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25mk8" Jul 09 15:27:21.713331 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.713308 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:27:21.846445 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.846406 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpfd6"] Jul 09 15:27:21.849750 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:27:21.849716 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f64724a_3d0f_4884_a141_b00744e85199.slice/crio-7b01b5fce36d8b8dad0dddeab840bcb9d524634b7c8498767ce61552509f9ca4 WatchSource:0}: Error finding container 7b01b5fce36d8b8dad0dddeab840bcb9d524634b7c8498767ce61552509f9ca4: Status 404 returned error can't find the container with id 7b01b5fce36d8b8dad0dddeab840bcb9d524634b7c8498767ce61552509f9ca4 Jul 09 15:27:21.863063 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:21.863038 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25mk8"] Jul 09 15:27:21.865696 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:27:21.865658 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932a0aa0_dc25_4e87_b76a_0b0f68f5b0a4.slice/crio-0e0348c63971dcec6653a928df60e30cadcfe91d5aeefba8414b1dc39cf48a4d WatchSource:0}: Error finding container 0e0348c63971dcec6653a928df60e30cadcfe91d5aeefba8414b1dc39cf48a4d: Status 404 returned error can't find the container with id 0e0348c63971dcec6653a928df60e30cadcfe91d5aeefba8414b1dc39cf48a4d Jul 09 15:27:22.241557 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:22.241518 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpfd6" event={"ID":"9f64724a-3d0f-4884-a141-b00744e85199","Type":"ContainerStarted","Data":"7b01b5fce36d8b8dad0dddeab840bcb9d524634b7c8498767ce61552509f9ca4"} Jul 09 15:27:22.242582 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:22.242559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25mk8" event={"ID":"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4","Type":"ContainerStarted","Data":"0e0348c63971dcec6653a928df60e30cadcfe91d5aeefba8414b1dc39cf48a4d"} Jul 09 15:27:24.026149 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:24.026094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:27:24.026634 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:24.026274 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:24.026634 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:24.026343 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:56.02632376 +0000 UTC m=+99.805064554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:27:27.257601 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:27.257546 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpfd6" event={"ID":"9f64724a-3d0f-4884-a141-b00744e85199","Type":"ContainerStarted","Data":"10ed5db62dba5117480155349c04f53a7873db5d9a6e7c6088c996aeef5a3b34"} Jul 09 15:27:27.258010 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:27.257709 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:27:27.276049 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:27.275982 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fpfd6" podStartSLOduration=65.025445176 podStartE2EDuration="1m10.275961339s" totalImagesPullingTime="5.250516163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:27.275402011 +0000 UTC m=+71.054142840" watchObservedRunningTime="2026-07-09 15:27:27.275961339 +0000 UTC m=+71.054702130" Jul 09 15:27:28.263678 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:28.263642 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25mk8" event={"ID":"932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4","Type":"ContainerStarted","Data":"97562316e8dfc0ef6d36e2f690f7a86b3a26e12880bca87824a9c2a67faebfe2"} Jul 09 15:27:28.282378 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:28.282329 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-25mk8" podStartSLOduration=66.03540054 podStartE2EDuration="1m11.282312431s" totalImagesPullingTime="5.246911891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:28.281602314 +0000 UTC m=+72.060343125" watchObservedRunningTime="2026-07-09 15:27:28.282312431 +0000 UTC m=+72.061053240" Jul 09 15:27:56.049848 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:56.049807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:27:56.050300 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:56.049920 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:56.050300 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:27:56.049972 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:29:00.049958793 +0000 UTC m=+163.828699581 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:27:58.266011 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:27:58.265974 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fpfd6" Jul 09 15:28:25.557941 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:28:25.557882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:28:25.558510 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:28:25.558055 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:28:25.558510 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:28:25.558155 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs podName:a5478fed-b36a-46ec-8007-a17271377208 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:27.558133933 +0000 UTC m=+251.336874724 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs") pod "network-metrics-daemon-8sb66" (UID: "a5478fed-b36a-46ec-8007-a17271377208") : secret "metrics-daemon-secret" not found Jul 09 15:28:55.170332 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:28:55.170286 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6kgcn" podUID="9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5" Jul 09 15:28:55.466320 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:28:55.466229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:28:56.817285 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:28:56.817221 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8sb66" podUID="a5478fed-b36a-46ec-8007-a17271377208" Jul 09 15:29:00.097632 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:29:00.097577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:29:00.098010 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:29:00.097720 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:29:00.098010 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:29:00.097778 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls podName:9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:02.097763291 +0000 UTC m=+285.876504080 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls") pod "dns-default-6kgcn" (UID: "9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5") : secret "dns-default-metrics-tls" not found Jul 09 15:29:11.788856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:29:11.788806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:30:06.848968 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.848934 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj"] Jul 09 15:30:06.850832 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.850815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" Jul 09 15:30:06.854216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.854196 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-56b4r\"" Jul 09 15:30:06.855324 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.855309 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:06.855398 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.855308 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:06.862893 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.862868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj"] Jul 09 15:30:06.948827 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.948789 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55df9d5cb-wsm87"] Jul 09 15:30:06.950570 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.950551 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:30:06.950686 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.950669 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:06.952117 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.952094 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:06.953096 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.953075 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 15:30:06.953360 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.953343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s827\" (UniqueName: \"kubernetes.io/projected/f60018e2-8872-49c0-8bc6-61b97aa7449b-kube-api-access-5s827\") pod \"volume-data-source-validator-78495597f6-thxhj\" (UID: \"f60018e2-8872-49c0-8bc6-61b97aa7449b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" Jul 09 15:30:06.953593 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.953578 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 15:30:06.953787 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.953774 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 15:30:06.954357 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.954342 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 15:30:06.954404 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.954342 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dqqlh\"" Jul 09 15:30:06.954534 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.954517 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 15:30:06.957841 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.957822 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 15:30:06.957943 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.957892 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 15:30:06.958007 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.957971 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 15:30:06.958007 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.957979 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 15:30:06.958227 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.958212 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xlvdh\"" Jul 09 15:30:06.966357 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.966331 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 15:30:06.972996 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.972970 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55df9d5cb-wsm87"] Jul 09 15:30:06.973767 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:06.973750 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:30:07.046341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.046306 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq"] Jul 09 15:30:07.048104 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.048088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.050877 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.050850 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:07.050877 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.050868 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 15:30:07.051950 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.051935 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n2fzn\"" Jul 09 15:30:07.052002 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.051945 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:07.053755 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.053725 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s827\" (UniqueName: \"kubernetes.io/projected/f60018e2-8872-49c0-8bc6-61b97aa7449b-kube-api-access-5s827\") pod \"volume-data-source-validator-78495597f6-thxhj\" (UID: \"f60018e2-8872-49c0-8bc6-61b97aa7449b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" Jul 09 15:30:07.053755 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.053753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.053919 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.053888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.053974 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.053916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.054377 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.053941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.054511 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.054476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.054583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.054562 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.054636 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.054596 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.054636 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.054626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.055059 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.054825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.055163 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.055042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-default-certificate\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.055275 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.055186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-stats-auth\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.055431 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.055296 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4g8\" (UniqueName: \"kubernetes.io/projected/f529bde7-e470-4790-b8ab-e7bd2466c895-kube-api-access-2n4g8\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.055670 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.055588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9d2\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.060843 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.060819 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq"] Jul 09 15:30:07.065001 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.064975 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s827\" (UniqueName: \"kubernetes.io/projected/f60018e2-8872-49c0-8bc6-61b97aa7449b-kube-api-access-5s827\") pod \"volume-data-source-validator-78495597f6-thxhj\" (UID: \"f60018e2-8872-49c0-8bc6-61b97aa7449b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" Jul 09 15:30:07.156739 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.156739 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.156802 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.656782525 +0000 UTC m=+231.435523317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156820 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.156844 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.156899 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.656881198 +0000 UTC m=+231.435621993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : secret "router-metrics-certs-default" not found Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.156971 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156959 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.156982 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.156997 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d94cf94d8-bltbb: secret "image-registry-tls" not found Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.157034 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls podName:4df38592-1b49-4e6a-958a-ac1b504e0839 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.657022532 +0000 UTC m=+231.435763350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls") pod "image-registry-d94cf94d8-bltbb" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839") : secret "image-registry-tls" not found Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.156982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-default-certificate\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157109 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-stats-auth\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4g8\" (UniqueName: \"kubernetes.io/projected/f529bde7-e470-4790-b8ab-e7bd2466c895-kube-api-access-2n4g8\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157156 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2v9\" (UniqueName: \"kubernetes.io/projected/fdbde397-2757-4243-afc9-b5ee49807702-kube-api-access-hr2v9\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9d2\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157260 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.157452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.157296 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.158278 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.158229 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.158278 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.158269 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.159313 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.159292 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" Jul 09 15:30:07.159604 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.159582 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.159700 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.159679 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.159825 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.159806 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-default-certificate\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.160207 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.160178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-stats-auth\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.167756 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.167735 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4g8\" (UniqueName: \"kubernetes.io/projected/f529bde7-e470-4790-b8ab-e7bd2466c895-kube-api-access-2n4g8\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.168808 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.168786 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9d2\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.169057 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.169040 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.257818 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.257771 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2v9\" (UniqueName: \"kubernetes.io/projected/fdbde397-2757-4243-afc9-b5ee49807702-kube-api-access-hr2v9\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.257991 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.257864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.258066 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.258011 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:07.258116 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.258098 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls podName:fdbde397-2757-4243-afc9-b5ee49807702 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.758078431 +0000 UTC m=+231.536819222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls") pod "cluster-samples-operator-65db858894-dpfcq" (UID: "fdbde397-2757-4243-afc9-b5ee49807702") : secret "samples-operator-tls" not found Jul 09 15:30:07.272260 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.272206 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2v9\" (UniqueName: \"kubernetes.io/projected/fdbde397-2757-4243-afc9-b5ee49807702-kube-api-access-hr2v9\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.294023 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.293997 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj"] Jul 09 15:30:07.296402 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:07.296378 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60018e2_8872_49c0_8bc6_61b97aa7449b.slice/crio-1231a6b0c26a5dbef4782f447f61598b0e7e210d307e02f9a8d45c58b5316b27 WatchSource:0}: Error finding container 1231a6b0c26a5dbef4782f447f61598b0e7e210d307e02f9a8d45c58b5316b27: Status 404 returned error can't find the container with id 1231a6b0c26a5dbef4782f447f61598b0e7e210d307e02f9a8d45c58b5316b27 Jul 09 15:30:07.638663 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.638624 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" event={"ID":"f60018e2-8872-49c0-8bc6-61b97aa7449b","Type":"ContainerStarted","Data":"1231a6b0c26a5dbef4782f447f61598b0e7e210d307e02f9a8d45c58b5316b27"} Jul 09 15:30:07.661005 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.660968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.661163 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.661010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:07.661163 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.661030 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:07.661163 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661130 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:07.661163 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661136 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:07.661393 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661141 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d94cf94d8-bltbb: secret "image-registry-tls" not found Jul 09 15:30:07.661393 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661172 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.661149949 +0000 UTC m=+232.439890753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:07.661393 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661214 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.661200607 +0000 UTC m=+232.439941395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : secret "router-metrics-certs-default" not found Jul 09 15:30:07.661393 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.661257 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls podName:4df38592-1b49-4e6a-958a-ac1b504e0839 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.661225986 +0000 UTC m=+232.439966773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls") pod "image-registry-d94cf94d8-bltbb" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839") : secret "image-registry-tls" not found Jul 09 15:30:07.761558 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:07.761514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:07.761730 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.761673 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:07.761775 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:07.761740 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls podName:fdbde397-2757-4243-afc9-b5ee49807702 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.761724221 +0000 UTC m=+232.540465026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls") pod "cluster-samples-operator-65db858894-dpfcq" (UID: "fdbde397-2757-4243-afc9-b5ee49807702") : secret "samples-operator-tls" not found Jul 09 15:30:08.667641 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:08.667599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:08.667641 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:08.667637 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:08.667705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667746 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667803 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.667789666 +0000 UTC m=+234.446530454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667803 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667820 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.66781307 +0000 UTC m=+234.446553857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : secret "router-metrics-certs-default" not found Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667822 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d94cf94d8-bltbb: secret "image-registry-tls" not found Jul 09 15:30:08.668051 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.667858 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls podName:4df38592-1b49-4e6a-958a-ac1b504e0839 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.667844696 +0000 UTC m=+234.446585485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls") pod "image-registry-d94cf94d8-bltbb" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839") : secret "image-registry-tls" not found Jul 09 15:30:08.768644 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:08.768601 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:08.768794 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.768758 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:08.768832 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:08.768822 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls podName:fdbde397-2757-4243-afc9-b5ee49807702 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.76880861 +0000 UTC m=+234.547549398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls") pod "cluster-samples-operator-65db858894-dpfcq" (UID: "fdbde397-2757-4243-afc9-b5ee49807702") : secret "samples-operator-tls" not found Jul 09 15:30:10.647387 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.647303 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" event={"ID":"f60018e2-8872-49c0-8bc6-61b97aa7449b","Type":"ContainerStarted","Data":"5c15fb072120b122c6eb84e6bd6ce7c464d92fd4629aa6c53fda67d4a40206fb"} Jul 09 15:30:10.664838 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.664787 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-thxhj" podStartSLOduration=1.585827885 podStartE2EDuration="4.664770698s" totalImagesPullingTime="3.078942813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:10.663966478 +0000 UTC m=+234.442707290" watchObservedRunningTime="2026-07-09 15:30:10.664770698 +0000 UTC m=+234.443511508" Jul 09 15:30:10.684342 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.684303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:10.684485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.684349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:10.684485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.684374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:10.684485 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684465 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:14.684448677 +0000 UTC m=+238.463189465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:10.684485 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684463 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:10.684773 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684502 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:14.684495411 +0000 UTC m=+238.463236199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : secret "router-metrics-certs-default" not found Jul 09 15:30:10.684773 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684518 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:10.684773 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684534 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d94cf94d8-bltbb: secret "image-registry-tls" not found Jul 09 15:30:10.684773 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.684592 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls podName:4df38592-1b49-4e6a-958a-ac1b504e0839 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:14.684576445 +0000 UTC m=+238.463317260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls") pod "image-registry-d94cf94d8-bltbb" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839") : secret "image-registry-tls" not found Jul 09 15:30:10.785184 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:10.785145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:10.785343 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.785285 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:10.785343 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:10.785335 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls podName:fdbde397-2757-4243-afc9-b5ee49807702 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:14.785322414 +0000 UTC m=+238.564063202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls") pod "cluster-samples-operator-65db858894-dpfcq" (UID: "fdbde397-2757-4243-afc9-b5ee49807702") : secret "samples-operator-tls" not found Jul 09 15:30:11.874782 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.874745 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fvdf6"] Jul 09 15:30:11.876736 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.876719 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:11.879542 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.879521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 15:30:11.879697 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.879624 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 15:30:11.879989 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.879971 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 15:30:11.880873 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.880855 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8d7wp\"" Jul 09 15:30:11.881029 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.880884 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 15:30:11.920309 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.917871 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvdf6"] Jul 09 15:30:11.994546 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.994503 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8a7832-0acb-40f0-bac7-299f42a81ad3-data-volume\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:11.994546 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.994547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:11.994753 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.994647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8a7832-0acb-40f0-bac7-299f42a81ad3-crio-socket\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:11.994753 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.994695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfm27\" (UniqueName: \"kubernetes.io/projected/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-api-access-bfm27\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:11.994753 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:11.994713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.095920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.095875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8a7832-0acb-40f0-bac7-299f42a81ad3-crio-socket\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.095920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.095919 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfm27\" (UniqueName: \"kubernetes.io/projected/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-api-access-bfm27\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.096126 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.095943 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.096126 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.096008 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8a7832-0acb-40f0-bac7-299f42a81ad3-crio-socket\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.096126 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.096019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8a7832-0acb-40f0-bac7-299f42a81ad3-data-volume\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.096126 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.096044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.096126 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.096124 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:12.096316 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.096142 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.096316 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.096189 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.596169237 +0000 UTC m=+236.374910025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : configmap "kube-rbac-proxy" not found Jul 09 15:30:12.096316 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.096206 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.59619739 +0000 UTC m=+236.374938178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.096423 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.096397 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8a7832-0acb-40f0-bac7-299f42a81ad3-data-volume\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.106187 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.106156 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfm27\" (UniqueName: \"kubernetes.io/projected/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-api-access-bfm27\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.600230 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.600169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.600438 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.600283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:12.600438 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.600318 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:12.600438 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.600390 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:13.600372815 +0000 UTC m=+237.379113603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : configmap "kube-rbac-proxy" not found Jul 09 15:30:12.600438 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.600407 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.600619 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:12.600445 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:13.600434885 +0000 UTC m=+237.379175674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.779033 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.778995 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn"] Jul 09 15:30:12.780907 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.780890 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" Jul 09 15:30:12.783622 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.783591 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:12.784678 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.784655 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b9knq\"" Jul 09 15:30:12.784770 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.784681 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 15:30:12.792667 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.792644 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn"] Jul 09 15:30:12.904048 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:12.903952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4qp\" (UniqueName: \"kubernetes.io/projected/42b6e3ee-a443-4275-bb0f-44422429975c-kube-api-access-cq4qp\") pod \"migrator-7f59b54f6c-77cmn\" (UID: \"42b6e3ee-a443-4275-bb0f-44422429975c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" Jul 09 15:30:13.004747 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.004688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4qp\" (UniqueName: \"kubernetes.io/projected/42b6e3ee-a443-4275-bb0f-44422429975c-kube-api-access-cq4qp\") pod \"migrator-7f59b54f6c-77cmn\" (UID: \"42b6e3ee-a443-4275-bb0f-44422429975c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" Jul 09 15:30:13.017373 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.017351 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4qp\" (UniqueName: \"kubernetes.io/projected/42b6e3ee-a443-4275-bb0f-44422429975c-kube-api-access-cq4qp\") pod \"migrator-7f59b54f6c-77cmn\" (UID: \"42b6e3ee-a443-4275-bb0f-44422429975c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" Jul 09 15:30:13.090569 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.090524 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" Jul 09 15:30:13.217647 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.217615 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn"] Jul 09 15:30:13.220415 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:13.220378 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b6e3ee_a443_4275_bb0f_44422429975c.slice/crio-ca7788d847e9110ed20b768c48c0b01e15cff2862091f378ee7629970f2480e5 WatchSource:0}: Error finding container ca7788d847e9110ed20b768c48c0b01e15cff2862091f378ee7629970f2480e5: Status 404 returned error can't find the container with id ca7788d847e9110ed20b768c48c0b01e15cff2862091f378ee7629970f2480e5 Jul 09 15:30:13.610280 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.610213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:13.610482 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.610338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:13.610482 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:13.610349 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:13.610482 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:13.610408 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.610393537 +0000 UTC m=+239.389134325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : configmap "kube-rbac-proxy" not found Jul 09 15:30:13.610668 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:13.610485 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:13.610668 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:13.610548 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.610525801 +0000 UTC m=+239.389266609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:13.656104 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.656060 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" event={"ID":"42b6e3ee-a443-4275-bb0f-44422429975c","Type":"ContainerStarted","Data":"ca7788d847e9110ed20b768c48c0b01e15cff2862091f378ee7629970f2480e5"} Jul 09 15:30:13.940264 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:13.940170 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nflcx_2ec6370b-061a-49f0-8fec-6c4d21693e47/dns-node-resolver/0.log" Jul 09 15:30:14.720262 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:14.720198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:14.720262 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:14.720254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:14.720322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720387 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720443 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720460 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d94cf94d8-bltbb: secret "image-registry-tls" not found Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720468 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.720447383 +0000 UTC m=+246.499188231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : secret "router-metrics-certs-default" not found Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720488 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle podName:f529bde7-e470-4790-b8ab-e7bd2466c895 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.720478859 +0000 UTC m=+246.499219648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle") pod "router-default-55df9d5cb-wsm87" (UID: "f529bde7-e470-4790-b8ab-e7bd2466c895") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:14.720532 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.720512 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls podName:4df38592-1b49-4e6a-958a-ac1b504e0839 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.720494471 +0000 UTC m=+246.499235259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls") pod "image-registry-d94cf94d8-bltbb" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839") : secret "image-registry-tls" not found Jul 09 15:30:14.745310 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:14.745282 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2zl9_2765aa5c-e7e9-4443-a96b-579037e9ebed/node-ca/0.log" Jul 09 15:30:14.820729 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:14.820690 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:14.820880 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.820841 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:14.820917 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:14.820906 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls podName:fdbde397-2757-4243-afc9-b5ee49807702 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.820889819 +0000 UTC m=+246.599630628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls") pod "cluster-samples-operator-65db858894-dpfcq" (UID: "fdbde397-2757-4243-afc9-b5ee49807702") : secret "samples-operator-tls" not found Jul 09 15:30:15.627965 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:15.627923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:15.628488 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:15.628053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:15.628488 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:15.628125 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.628488 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:15.628215 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:19.628192215 +0000 UTC m=+243.406933015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.628488 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:15.628210 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:15.628488 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:15.628316 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:19.62829843 +0000 UTC m=+243.407039219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : configmap "kube-rbac-proxy" not found Jul 09 15:30:15.739671 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:15.739632 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9dcfs_340d850e-c7ed-4014-87ab-c132b2bf7900/serve-healthcheck-canary/0.log" Jul 09 15:30:16.665633 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:16.665593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" event={"ID":"42b6e3ee-a443-4275-bb0f-44422429975c","Type":"ContainerStarted","Data":"5ac3b99f0c7997549fa29d817dc41269f8f7b215671df80656dd9f5b6fd93eeb"} Jul 09 15:30:16.666123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:16.665693 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" event={"ID":"42b6e3ee-a443-4275-bb0f-44422429975c","Type":"ContainerStarted","Data":"96bd079513a216f9ffeeeda5abe52a85f1d79f9613e3de6b2478e42e1aa0e542"} Jul 09 15:30:16.724340 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:16.724281 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-77cmn" podStartSLOduration=2.267726826 podStartE2EDuration="4.724262858s" totalImagesPullingTime="2.456536032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:16.724139121 +0000 UTC m=+240.502879945" watchObservedRunningTime="2026-07-09 15:30:16.724262858 +0000 UTC m=+240.503003669" Jul 09 15:30:19.662851 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:19.662793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:19.663265 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:19.662891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:19.663265 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:19.662933 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:19.663265 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:19.662975 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:19.663265 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:19.662996 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:27.662980092 +0000 UTC m=+251.441720880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : configmap "kube-rbac-proxy" not found Jul 09 15:30:19.663265 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:19.663016 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls podName:bd8a7832-0acb-40f0-bac7-299f42a81ad3 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:27.66300496 +0000 UTC m=+251.441745748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvdf6" (UID: "bd8a7832-0acb-40f0-bac7-299f42a81ad3") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:22.787499 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.787454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:22.787499 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.787504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:22.788059 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.787617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:22.788332 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.788310 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f529bde7-e470-4790-b8ab-e7bd2466c895-service-ca-bundle\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:22.790007 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.789986 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"image-registry-d94cf94d8-bltbb\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:22.790286 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.790267 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f529bde7-e470-4790-b8ab-e7bd2466c895-metrics-certs\") pod \"router-default-55df9d5cb-wsm87\" (UID: \"f529bde7-e470-4790-b8ab-e7bd2466c895\") " pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:22.864095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.864058 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dqqlh\"" Jul 09 15:30:22.871169 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.871138 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:22.871418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.871396 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xlvdh\"" Jul 09 15:30:22.878095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.878078 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:22.888711 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.888682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:22.891275 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.891228 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdbde397-2757-4243-afc9-b5ee49807702-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dpfcq\" (UID: \"fdbde397-2757-4243-afc9-b5ee49807702\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:22.963401 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.963369 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n2fzn\"" Jul 09 15:30:22.971329 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:22.971294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" Jul 09 15:30:23.022510 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.022445 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55df9d5cb-wsm87"] Jul 09 15:30:23.027326 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:23.027287 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf529bde7_e470_4790_b8ab_e7bd2466c895.slice/crio-2805b98dfad454e6d7fc8d12a369d739456d3c7ce3052c3e13e8f10a9004b02e WatchSource:0}: Error finding container 2805b98dfad454e6d7fc8d12a369d739456d3c7ce3052c3e13e8f10a9004b02e: Status 404 returned error can't find the container with id 2805b98dfad454e6d7fc8d12a369d739456d3c7ce3052c3e13e8f10a9004b02e Jul 09 15:30:23.039107 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.038813 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:30:23.044740 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:23.044694 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df38592_1b49_4e6a_958a_ac1b504e0839.slice/crio-9db830b9f880e5a0a8daa7f6a0e35339b499db29abe97c8c623ddb4546c71cba WatchSource:0}: Error finding container 9db830b9f880e5a0a8daa7f6a0e35339b499db29abe97c8c623ddb4546c71cba: Status 404 returned error can't find the container with id 9db830b9f880e5a0a8daa7f6a0e35339b499db29abe97c8c623ddb4546c71cba Jul 09 15:30:23.118891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.118856 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq"] Jul 09 15:30:23.686666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.686628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" event={"ID":"4df38592-1b49-4e6a-958a-ac1b504e0839","Type":"ContainerStarted","Data":"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056"} Jul 09 15:30:23.686868 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.686680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" event={"ID":"4df38592-1b49-4e6a-958a-ac1b504e0839","Type":"ContainerStarted","Data":"9db830b9f880e5a0a8daa7f6a0e35339b499db29abe97c8c623ddb4546c71cba"} Jul 09 15:30:23.686868 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.686746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:30:23.688213 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.688188 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55df9d5cb-wsm87" event={"ID":"f529bde7-e470-4790-b8ab-e7bd2466c895","Type":"ContainerStarted","Data":"efbaafbbecea7eecd767b24ff282102b96d344c1da4fd9aece2dfa15b66919d4"} Jul 09 15:30:23.688320 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.688228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55df9d5cb-wsm87" event={"ID":"f529bde7-e470-4790-b8ab-e7bd2466c895","Type":"ContainerStarted","Data":"2805b98dfad454e6d7fc8d12a369d739456d3c7ce3052c3e13e8f10a9004b02e"} Jul 09 15:30:23.689137 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.689118 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" event={"ID":"fdbde397-2757-4243-afc9-b5ee49807702","Type":"ContainerStarted","Data":"dacf07ceee6157ebf532356894212835c2a326e07350f83846fc9398b63619d0"} Jul 09 15:30:23.713277 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.713207 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" podStartSLOduration=17.713191905 podStartE2EDuration="17.713191905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:23.711603146 +0000 UTC m=+247.490343947" watchObservedRunningTime="2026-07-09 15:30:23.713191905 +0000 UTC m=+247.491932715" Jul 09 15:30:23.734216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.734160 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55df9d5cb-wsm87" podStartSLOduration=17.734144235 podStartE2EDuration="17.734144235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:23.733802468 +0000 UTC m=+247.512543278" watchObservedRunningTime="2026-07-09 15:30:23.734144235 +0000 UTC m=+247.512885044" Jul 09 15:30:23.872100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.872063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:23.874736 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:23.874713 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:24.692800 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:24.692771 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:24.694149 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:24.694126 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55df9d5cb-wsm87" Jul 09 15:30:25.697324 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:25.697281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" event={"ID":"fdbde397-2757-4243-afc9-b5ee49807702","Type":"ContainerStarted","Data":"d5fee731b4e164b35a133578075456fd7a83833210359b0f8c1ced3278105c22"} Jul 09 15:30:25.697713 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:25.697340 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" event={"ID":"fdbde397-2757-4243-afc9-b5ee49807702","Type":"ContainerStarted","Data":"a046c18a6cfca5bb3868a1fe632718b1f449ec63856161c98292e5d3c3004098"} Jul 09 15:30:25.718765 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:25.718713 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dpfcq" podStartSLOduration=16.948625736 podStartE2EDuration="18.718697095s" totalImagesPullingTime="1.770071359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:25.718024211 +0000 UTC m=+249.496765022" watchObservedRunningTime="2026-07-09 15:30:25.718697095 +0000 UTC m=+249.497437917" Jul 09 15:30:27.628309 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.628269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:30:27.630693 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.630671 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5478fed-b36a-46ec-8007-a17271377208-metrics-certs\") pod \"network-metrics-daemon-8sb66\" (UID: \"a5478fed-b36a-46ec-8007-a17271377208\") " pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:30:27.692700 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.692667 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb7pf\"" Jul 09 15:30:27.700216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.700192 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb66" Jul 09 15:30:27.729388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.729354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:27.729543 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.729415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:27.729870 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.729846 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8a7832-0acb-40f0-bac7-299f42a81ad3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:27.731747 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.731725 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8a7832-0acb-40f0-bac7-299f42a81ad3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvdf6\" (UID: \"bd8a7832-0acb-40f0-bac7-299f42a81ad3\") " pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:27.788229 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.788201 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8d7wp\"" Jul 09 15:30:27.796152 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.795899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvdf6" Jul 09 15:30:27.829324 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.829287 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8sb66"] Jul 09 15:30:27.832775 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:27.832748 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5478fed_b36a_46ec_8007_a17271377208.slice/crio-63df6e5a87e6134dda2abe7d2a4c6c615efc7bf6653a6b117d9d8d6fd78341e3 WatchSource:0}: Error finding container 63df6e5a87e6134dda2abe7d2a4c6c615efc7bf6653a6b117d9d8d6fd78341e3: Status 404 returned error can't find the container with id 63df6e5a87e6134dda2abe7d2a4c6c615efc7bf6653a6b117d9d8d6fd78341e3 Jul 09 15:30:27.932147 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:27.932109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvdf6"] Jul 09 15:30:27.934742 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:27.934712 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8a7832_0acb_40f0_bac7_299f42a81ad3.slice/crio-0bd5503a4f359d98e7f594c2382fb506b0521e6f1433eedefe16b08a625f3803 WatchSource:0}: Error finding container 0bd5503a4f359d98e7f594c2382fb506b0521e6f1433eedefe16b08a625f3803: Status 404 returned error can't find the container with id 0bd5503a4f359d98e7f594c2382fb506b0521e6f1433eedefe16b08a625f3803 Jul 09 15:30:28.706675 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:28.706642 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb66" event={"ID":"a5478fed-b36a-46ec-8007-a17271377208","Type":"ContainerStarted","Data":"63df6e5a87e6134dda2abe7d2a4c6c615efc7bf6653a6b117d9d8d6fd78341e3"} Jul 09 15:30:28.707631 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:28.707610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvdf6" event={"ID":"bd8a7832-0acb-40f0-bac7-299f42a81ad3","Type":"ContainerStarted","Data":"0bd5503a4f359d98e7f594c2382fb506b0521e6f1433eedefe16b08a625f3803"} Jul 09 15:30:29.712740 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:29.712708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb66" event={"ID":"a5478fed-b36a-46ec-8007-a17271377208","Type":"ContainerStarted","Data":"563b19332d1d467d5b2bd7446d68bc14ffeb00b9cba94275d47ba59fd3b00568"} Jul 09 15:30:29.713113 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:29.712759 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb66" event={"ID":"a5478fed-b36a-46ec-8007-a17271377208","Type":"ContainerStarted","Data":"45c1b01112602013e7efefc829b3c7249f2c5f75c3c91e580bfa902f5de6da7d"} Jul 09 15:30:29.731379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:29.731332 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8sb66" podStartSLOduration=251.849391703 podStartE2EDuration="4m12.731317289s" totalImagesPullingTime="881.925586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:29.730810262 +0000 UTC m=+253.509551072" watchObservedRunningTime="2026-07-09 15:30:29.731317289 +0000 UTC m=+253.510058100" Jul 09 15:30:34.731056 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:34.730965 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvdf6" event={"ID":"bd8a7832-0acb-40f0-bac7-299f42a81ad3","Type":"ContainerStarted","Data":"d8d5bd660c2cc3e444dd2a429bef49e4dd5de9bf072bea00f23e7e72573ee35a"} Jul 09 15:30:35.735605 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:35.735570 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvdf6" event={"ID":"bd8a7832-0acb-40f0-bac7-299f42a81ad3","Type":"ContainerStarted","Data":"09715074d1a997554dc0526f7604efe84d1082c4365056c6962f35329d822115"} Jul 09 15:30:38.241861 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:38.241788 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:30:38.247713 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:38.247669 2557 patch_prober.go:28] interesting pod/image-registry-d94cf94d8-bltbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:38.247887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:38.247729 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:38.747218 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:38.747184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvdf6" event={"ID":"bd8a7832-0acb-40f0-bac7-299f42a81ad3","Type":"ContainerStarted","Data":"6060678aff47f64875cf926dc286deb3ed3dfef1c589723f6d2e7c5b13a1af82"} Jul 09 15:30:38.770744 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:38.770691 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fvdf6" podStartSLOduration=17.265987391 podStartE2EDuration="27.77067268s" totalImagesPullingTime="10.504685289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:38.769634678 +0000 UTC m=+262.548375488" watchObservedRunningTime="2026-07-09 15:30:38.77067268 +0000 UTC m=+262.549413527" Jul 09 15:30:48.247138 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.247101 2557 patch_prober.go:28] interesting pod/image-registry-d94cf94d8-bltbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:48.247564 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.247159 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:48.807746 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.807708 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:30:48.838314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.838284 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:30:48.838480 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.838335 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.841742 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.841713 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 15:30:48.841884 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.841718 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 15:30:48.842019 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.842003 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 15:30:48.842091 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.842046 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 15:30:48.842148 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.842050 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 15:30:48.843222 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.843193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bvh5j\"" Jul 09 15:30:48.843222 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.843219 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 15:30:48.843407 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.843271 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 15:30:48.847719 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.847700 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 15:30:48.887678 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.887678 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.888012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.888012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.888012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.888012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsbjr\" (UniqueName: \"kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.888012 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.887820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988519 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988519 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsbjr\" (UniqueName: \"kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988735 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988735 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988693 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988735 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988855 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.988855 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.988807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.989329 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.989304 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.989682 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.989452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.989682 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.989566 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.989809 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.989661 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.991345 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.991328 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.991418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.991399 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:48.998071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:48.998046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsbjr\" (UniqueName: \"kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr\") pod \"console-5f95f6b794-p6gbn\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:49.148125 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:49.148039 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:49.296389 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:49.296364 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:30:49.298648 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:49.298621 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e20e2eb_0bef_480d_8205_dcf1778c8e86.slice/crio-a450dbc511199cd87be515b0584457bd575c81d609a518b2a88856aa17d155c8 WatchSource:0}: Error finding container a450dbc511199cd87be515b0584457bd575c81d609a518b2a88856aa17d155c8: Status 404 returned error can't find the container with id a450dbc511199cd87be515b0584457bd575c81d609a518b2a88856aa17d155c8 Jul 09 15:30:49.783228 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:49.783189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f95f6b794-p6gbn" event={"ID":"7e20e2eb-0bef-480d-8205-dcf1778c8e86","Type":"ContainerStarted","Data":"a450dbc511199cd87be515b0584457bd575c81d609a518b2a88856aa17d155c8"} Jul 09 15:30:50.351580 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.351542 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s"] Jul 09 15:30:50.354024 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.353972 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.356819 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.356794 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 15:30:50.356963 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.356801 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 15:30:50.357964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.357945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 15:30:50.357964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.357957 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 15:30:50.358089 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.357958 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wnfts\"" Jul 09 15:30:50.358089 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.357988 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 15:30:50.368622 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.368591 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s"] Jul 09 15:30:50.371966 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.371940 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-442rw"] Jul 09 15:30:50.374045 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.374024 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.377068 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.377044 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 15:30:50.377251 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.377215 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 15:30:50.377620 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.377589 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 15:30:50.377713 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.377624 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h9fnh\"" Jul 09 15:30:50.378031 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.378012 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2nzhc"] Jul 09 15:30:50.379929 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.379910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.382382 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.382361 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 15:30:50.382485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.382462 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 15:30:50.382485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.382470 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 15:30:50.382609 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.382579 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g7h59\"" Jul 09 15:30:50.392691 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.392666 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-442rw"] Jul 09 15:30:50.399952 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.399925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5mhk\" (UniqueName: \"kubernetes.io/projected/b849a374-3f7b-4ce2-86a1-d9e261093c60-kube-api-access-t5mhk\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400111 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.399955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400111 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.399979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400111 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.399997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-sys\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400111 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5f485a03-12c4-4d29-b848-d0828baaacc6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-tls\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-root\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppjg\" (UniqueName: \"kubernetes.io/projected/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-kube-api-access-nppjg\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.400273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7f2\" (UniqueName: \"kubernetes.io/projected/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-api-access-cc7f2\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-wtmp\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-metrics-client-ca\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400379 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.400428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400412 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.400631 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400431 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-textfile\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.400631 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.400477 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.501520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7f2\" (UniqueName: \"kubernetes.io/projected/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-api-access-cc7f2\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.501520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-wtmp\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.501520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-metrics-client-ca\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501648 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-wtmp\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.501815 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-textfile\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502153 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.501839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.502153 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502136 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-textfile\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502306 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5mhk\" (UniqueName: \"kubernetes.io/projected/b849a374-3f7b-4ce2-86a1-d9e261093c60-kube-api-access-t5mhk\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502306 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.502306 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.502462 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-sys\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502462 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5f485a03-12c4-4d29-b848-d0828baaacc6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.502462 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502392 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-metrics-client-ca\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502462 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:50.502437 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:50.502499 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls podName:5f485a03-12c4-4d29-b848-d0828baaacc6 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:51.002479554 +0000 UTC m=+274.781220355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-442rw" (UID: "5f485a03-12c4-4d29-b848-d0828baaacc6") : secret "kube-state-metrics-tls" not found Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502500 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-sys\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-tls\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502620 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.502666 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502651 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5f485a03-12c4-4d29-b848-d0828baaacc6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.503027 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-root\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.503027 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502684 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b849a374-3f7b-4ce2-86a1-d9e261093c60-root\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.503027 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppjg\" (UniqueName: \"kubernetes.io/projected/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-kube-api-access-nppjg\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.503027 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.502772 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.503448 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.503401 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.503572 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.503445 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.504870 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.504818 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.505114 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.505095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.505258 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.505212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.505330 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.505212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.505330 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.505315 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b849a374-3f7b-4ce2-86a1-d9e261093c60-node-exporter-tls\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.512924 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.512890 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppjg\" (UniqueName: \"kubernetes.io/projected/42fe24ee-094b-40da-b7a4-b1f8fd1ec15c-kube-api-access-nppjg\") pod \"openshift-state-metrics-84bd68b896-f8n9s\" (UID: \"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.513068 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.513047 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7f2\" (UniqueName: \"kubernetes.io/projected/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-api-access-cc7f2\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:50.513297 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.513281 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5mhk\" (UniqueName: \"kubernetes.io/projected/b849a374-3f7b-4ce2-86a1-d9e261093c60-kube-api-access-t5mhk\") pod \"node-exporter-2nzhc\" (UID: \"b849a374-3f7b-4ce2-86a1-d9e261093c60\") " pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.668184 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.668092 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" Jul 09 15:30:50.690164 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.690129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nzhc" Jul 09 15:30:50.700022 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:50.699984 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb849a374_3f7b_4ce2_86a1_d9e261093c60.slice/crio-16b67f63d059cbe3908a48f7d8e0f7e2e448ae1fa988321c6d199276dc2e9611 WatchSource:0}: Error finding container 16b67f63d059cbe3908a48f7d8e0f7e2e448ae1fa988321c6d199276dc2e9611: Status 404 returned error can't find the container with id 16b67f63d059cbe3908a48f7d8e0f7e2e448ae1fa988321c6d199276dc2e9611 Jul 09 15:30:50.788140 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.788095 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nzhc" event={"ID":"b849a374-3f7b-4ce2-86a1-d9e261093c60","Type":"ContainerStarted","Data":"16b67f63d059cbe3908a48f7d8e0f7e2e448ae1fa988321c6d199276dc2e9611"} Jul 09 15:30:50.808569 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:50.808508 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s"] Jul 09 15:30:50.810962 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:50.810934 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fe24ee_094b_40da_b7a4_b1f8fd1ec15c.slice/crio-7a62ccf79329c33137567eb39569ba95c7f677f4c6b1e87501873044e34922a0 WatchSource:0}: Error finding container 7a62ccf79329c33137567eb39569ba95c7f677f4c6b1e87501873044e34922a0: Status 404 returned error can't find the container with id 7a62ccf79329c33137567eb39569ba95c7f677f4c6b1e87501873044e34922a0 Jul 09 15:30:51.008584 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.008540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:51.011225 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.011198 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f485a03-12c4-4d29-b848-d0828baaacc6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-442rw\" (UID: \"5f485a03-12c4-4d29-b848-d0828baaacc6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:51.283094 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.283061 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" Jul 09 15:30:51.437496 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.437350 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-442rw"] Jul 09 15:30:51.440766 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.440737 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:51.441068 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:51.441036 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f485a03_12c4_4d29_b848_d0828baaacc6.slice/crio-6da628065deff66a828a244afe3c55911e5d403c806b48d20ec99db73fbf9d36 WatchSource:0}: Error finding container 6da628065deff66a828a244afe3c55911e5d403c806b48d20ec99db73fbf9d36: Status 404 returned error can't find the container with id 6da628065deff66a828a244afe3c55911e5d403c806b48d20ec99db73fbf9d36 Jul 09 15:30:51.443803 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.443781 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.447650 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.447623 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 15:30:51.447650 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.447645 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 15:30:51.447824 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.447726 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 15:30:51.447932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.447915 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 15:30:51.447999 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.447965 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 15:30:51.448166 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.448148 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 15:30:51.448253 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.448150 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 15:30:51.448253 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.448171 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 15:30:51.448365 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.448328 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 15:30:51.449008 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.448989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ck25m\"" Jul 09 15:30:51.465846 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.465809 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:51.513448 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513403 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513448 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-web-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-out\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tb88\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-kube-api-access-8tb88\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513639 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513703 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513726 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.513932 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.514156 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.513970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615499 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615499 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-web-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-out\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tb88\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-kube-api-access-8tb88\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.615720 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.615862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:51.615934 2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 15:30:51.616075 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:51.616001 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls podName:4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae nodeName:}" failed. No retries permitted until 2026-07-09 15:30:52.11597844 +0000 UTC m=+275.894719244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae") : secret "alertmanager-main-tls" not found Jul 09 15:30:51.616421 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.616299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.617178 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.617151 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.617482 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.617458 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.619317 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.619288 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.619858 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.619588 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.619858 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.619803 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-config-out\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.620130 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.620105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.620204 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.620126 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.621306 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.621283 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.621700 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.621678 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-web-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.621816 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.621772 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.628527 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.628497 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tb88\" (UniqueName: \"kubernetes.io/projected/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-kube-api-access-8tb88\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:51.794795 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.794757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" event={"ID":"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c","Type":"ContainerStarted","Data":"4ef2efdbb3f8af94c5b8495707f7f42c0e3046250f3ce626dea68bc522a8d4e2"} Jul 09 15:30:51.794963 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.794820 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" event={"ID":"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c","Type":"ContainerStarted","Data":"ad0e1e7302293cea22de1c853e0c9ac2d4defb843e6e9119e2a95c586a0d9fc7"} Jul 09 15:30:51.794963 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.794847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" event={"ID":"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c","Type":"ContainerStarted","Data":"7a62ccf79329c33137567eb39569ba95c7f677f4c6b1e87501873044e34922a0"} Jul 09 15:30:51.795891 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:51.795867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" event={"ID":"5f485a03-12c4-4d29-b848-d0828baaacc6","Type":"ContainerStarted","Data":"6da628065deff66a828a244afe3c55911e5d403c806b48d20ec99db73fbf9d36"} Jul 09 15:30:52.121695 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.121663 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:52.124679 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.124652 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:52.358301 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.358198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:52.517480 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.517455 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:52.520690 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:52.520657 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad59c33_bff1_4ad6_8af4_3ca0c24e12ae.slice/crio-6d351b5fc69c3afde57ff5534c4723031f54f2b83cee5d67148c40b501f9a905 WatchSource:0}: Error finding container 6d351b5fc69c3afde57ff5534c4723031f54f2b83cee5d67148c40b501f9a905: Status 404 returned error can't find the container with id 6d351b5fc69c3afde57ff5534c4723031f54f2b83cee5d67148c40b501f9a905 Jul 09 15:30:52.803196 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.803090 2557 generic.go:356] "Generic (PLEG): container finished" podID="b849a374-3f7b-4ce2-86a1-d9e261093c60" containerID="11ef7367388fa3590d74547f55f15565b31af78463cf847735bccfb643ed32f1" exitCode=0 Jul 09 15:30:52.803196 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.803174 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nzhc" event={"ID":"b849a374-3f7b-4ce2-86a1-d9e261093c60","Type":"ContainerDied","Data":"11ef7367388fa3590d74547f55f15565b31af78463cf847735bccfb643ed32f1"} Jul 09 15:30:52.805896 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.805863 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" event={"ID":"42fe24ee-094b-40da-b7a4-b1f8fd1ec15c","Type":"ContainerStarted","Data":"401b75666f5d29f390a84aeb45a20335d9c0d2d637e687f3eef6ae225aad6780"} Jul 09 15:30:52.807322 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.807291 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"6d351b5fc69c3afde57ff5534c4723031f54f2b83cee5d67148c40b501f9a905"} Jul 09 15:30:52.843345 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:52.843287 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-f8n9s" podStartSLOduration=1.743534301 podStartE2EDuration="2.843262419s" totalImagesPullingTime="1.099728118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:52.842225911 +0000 UTC m=+276.620966791" watchObservedRunningTime="2026-07-09 15:30:52.843262419 +0000 UTC m=+276.622003230" Jul 09 15:30:53.815274 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.814976 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nzhc" event={"ID":"b849a374-3f7b-4ce2-86a1-d9e261093c60","Type":"ContainerStarted","Data":"9b106bcf70d027573e13af1a29f5a4e17457738ce42c0d770f7a2defb45b7942"} Jul 09 15:30:53.815274 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.815042 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nzhc" event={"ID":"b849a374-3f7b-4ce2-86a1-d9e261093c60","Type":"ContainerStarted","Data":"521a0b8983a670aed38930ef0b90fc687db52d6e20a472e6e3898489ea43db1b"} Jul 09 15:30:53.818413 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.817812 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" event={"ID":"5f485a03-12c4-4d29-b848-d0828baaacc6","Type":"ContainerStarted","Data":"6a9b1266e921154f35234cf7b7c2ca38b5281ba311a9905cfd0b9c79fb0bd8d5"} Jul 09 15:30:53.818413 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.817877 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" event={"ID":"5f485a03-12c4-4d29-b848-d0828baaacc6","Type":"ContainerStarted","Data":"5086fc30654ea2e0f9fc63383ea8daa879365d625a8c8a4918b2960eb3f1ba0d"} Jul 09 15:30:53.818413 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.817911 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" event={"ID":"5f485a03-12c4-4d29-b848-d0828baaacc6","Type":"ContainerStarted","Data":"c006aad11ff326d7243944cf37f62dedc881d676e1fc942c98938e7540cf02d7"} Jul 09 15:30:53.836877 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.836814 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2nzhc" podStartSLOduration=2.4391779160000002 podStartE2EDuration="3.836798037s" totalImagesPullingTime="1.319065822s" totalInitContainerRuntime="78.554299ms" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:53.834779364 +0000 UTC m=+277.613520176" watchObservedRunningTime="2026-07-09 15:30:53.836798037 +0000 UTC m=+277.615538825" Jul 09 15:30:53.859062 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:53.858995 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-442rw" podStartSLOduration=2.208850469 podStartE2EDuration="3.85897339s" totalImagesPullingTime="1.650122921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:53.857984287 +0000 UTC m=+277.636725098" watchObservedRunningTime="2026-07-09 15:30:53.85897339 +0000 UTC m=+277.637714201" Jul 09 15:30:55.826348 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:55.826306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f95f6b794-p6gbn" event={"ID":"7e20e2eb-0bef-480d-8205-dcf1778c8e86","Type":"ContainerStarted","Data":"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92"} Jul 09 15:30:55.827647 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:55.827619 2557 generic.go:356] "Generic (PLEG): container finished" podID="4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae" containerID="219fc51bdaacc5354ea3ceafbdadfc28d81bb8ea88cd03c8b5f29fa019af7099" exitCode=0 Jul 09 15:30:55.827733 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:55.827661 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerDied","Data":"219fc51bdaacc5354ea3ceafbdadfc28d81bb8ea88cd03c8b5f29fa019af7099"} Jul 09 15:30:55.850138 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:55.850081 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f95f6b794-p6gbn" podStartSLOduration=2.131461508 podStartE2EDuration="7.850064503s" totalImagesPullingTime="5.718602995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:55.847973464 +0000 UTC m=+279.626714310" watchObservedRunningTime="2026-07-09 15:30:55.850064503 +0000 UTC m=+279.628805315" Jul 09 15:30:56.468983 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.468928 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:30:56.471719 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.471699 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.482873 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.482796 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:30:56.561760 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.561920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.561920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqnn\" (UniqueName: \"kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.561920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.561920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.562048 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.562048 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.561952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663354 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663546 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663488 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663546 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqnn\" (UniqueName: \"kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663546 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663695 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663563 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663695 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.663789 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.663719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.664383 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.664351 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.664527 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.664496 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.664634 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.664614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.664866 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.664829 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.666350 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.666321 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.667089 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.667064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.673377 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.673351 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqnn\" (UniqueName: \"kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn\") pod \"console-66dc4644c8-cnlqz\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.784356 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.784309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:30:56.936859 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:56.936680 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:30:56.939378 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:30:56.939355 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e847c1_135d_463a_8e53_1c24cd29e848.slice/crio-fa337890b95e1df839b9d368e328796605809988649a50d011e6557190ddb382 WatchSource:0}: Error finding container fa337890b95e1df839b9d368e328796605809988649a50d011e6557190ddb382: Status 404 returned error can't find the container with id fa337890b95e1df839b9d368e328796605809988649a50d011e6557190ddb382 Jul 09 15:30:57.839379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.839338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"a5a2ff1c9ea59f5e6911fd179e333f9ed3bfabddce4fb52baf1a86777c8314c0"} Jul 09 15:30:57.839567 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.839454 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"1c0be971efad270126955dd75ce9cfc9722824a867c511171cf6009a088b3472"} Jul 09 15:30:57.839567 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.839491 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"b5aef18432005d06a9f156a724933368c7a341dc06033b16b661aa7b7529d955"} Jul 09 15:30:57.839567 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.839518 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"fbb83568317d3cbeecf14a435f2a2ef731d6d003bc751ce95b7941e9e635c5d0"} Jul 09 15:30:57.839567 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.839555 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"78b07cbd1140be4e8450ae63790ee53dea0e964071508af3a641f6c6d10608c9"} Jul 09 15:30:57.840744 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.840717 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc4644c8-cnlqz" event={"ID":"c6e847c1-135d-463a-8e53-1c24cd29e848","Type":"ContainerStarted","Data":"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3"} Jul 09 15:30:57.840839 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.840764 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc4644c8-cnlqz" event={"ID":"c6e847c1-135d-463a-8e53-1c24cd29e848","Type":"ContainerStarted","Data":"fa337890b95e1df839b9d368e328796605809988649a50d011e6557190ddb382"} Jul 09 15:30:57.862861 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:57.862804 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66dc4644c8-cnlqz" podStartSLOduration=1.862785284 podStartE2EDuration="1.862785284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:57.860412303 +0000 UTC m=+281.639153113" watchObservedRunningTime="2026-07-09 15:30:57.862785284 +0000 UTC m=+281.641526094" Jul 09 15:30:58.246206 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:58.246173 2557 patch_prober.go:28] interesting pod/image-registry-d94cf94d8-bltbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:58.246616 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:58.246227 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:58.467553 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:30:58.467506 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6kgcn" podUID="9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5" Jul 09 15:30:58.844419 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:58.844376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:30:59.148814 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:59.148720 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:59.149041 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:59.149019 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:30:59.150193 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:59.150167 2557 patch_prober.go:28] interesting pod/console-5f95f6b794-p6gbn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jul 09 15:30:59.150311 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:30:59.150212 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f95f6b794-p6gbn" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jul 09 15:31:01.860627 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:01.860593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae","Type":"ContainerStarted","Data":"9e53c08c8d0b92700488f56678360ef7eb561e2140bd53cf49a47b1211290b50"} Jul 09 15:31:01.895068 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:01.893861 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8870708819999997 podStartE2EDuration="10.893837805s" totalImagesPullingTime="7.990458194s" totalInitContainerRuntime="16.308729ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:01.88859256 +0000 UTC m=+285.667333372" watchObservedRunningTime="2026-07-09 15:31:01.893837805 +0000 UTC m=+285.672578619" Jul 09 15:31:02.117625 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.117580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:31:02.120100 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.120078 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5-metrics-tls\") pod \"dns-default-6kgcn\" (UID: \"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5\") " pod="openshift-dns/dns-default-6kgcn" Jul 09 15:31:02.148016 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.147932 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4b26\"" Jul 09 15:31:02.155411 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.155382 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:31:02.295294 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.295261 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6kgcn"] Jul 09 15:31:02.298592 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:31:02.298553 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0038cf_7f1f_4ecc_96d0_2a09acba9cd5.slice/crio-f128adb7c57d1c06c9ef3e49560c75fd4f4592419ead0d5014d9b28a28ce4912 WatchSource:0}: Error finding container f128adb7c57d1c06c9ef3e49560c75fd4f4592419ead0d5014d9b28a28ce4912: Status 404 returned error can't find the container with id f128adb7c57d1c06c9ef3e49560c75fd4f4592419ead0d5014d9b28a28ce4912 Jul 09 15:31:02.865429 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:02.865391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6kgcn" event={"ID":"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5","Type":"ContainerStarted","Data":"f128adb7c57d1c06c9ef3e49560c75fd4f4592419ead0d5014d9b28a28ce4912"} Jul 09 15:31:03.268063 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.268020 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" containerID="cri-o://0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056" gracePeriod=30 Jul 09 15:31:03.510192 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.510164 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:31:03.629947 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629851 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw9d2\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.629947 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629893 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.629947 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629912 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.629947 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629943 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.630283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629963 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.630283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.629985 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.630283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.630021 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.630283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.630055 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates\") pod \"4df38592-1b49-4e6a-958a-ac1b504e0839\" (UID: \"4df38592-1b49-4e6a-958a-ac1b504e0839\") " Jul 09 15:31:03.630579 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.630538 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:03.630670 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.630645 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:03.633095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.633059 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:03.633095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.633066 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2" (OuterVolumeSpecName: "kube-api-access-qw9d2") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "kube-api-access-qw9d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:03.633232 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.633105 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:03.633232 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.633105 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:03.633341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.633232 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:03.639257 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.639204 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4df38592-1b49-4e6a-958a-ac1b504e0839" (UID: "4df38592-1b49-4e6a-958a-ac1b504e0839"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:31:03.731639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731581 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw9d2\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-kube-api-access-qw9d2\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731631 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4df38592-1b49-4e6a-958a-ac1b504e0839-ca-trust-extracted\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731641 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731650 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df38592-1b49-4e6a-958a-ac1b504e0839-bound-sa-token\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731658 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-installation-pull-secrets\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731936 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731666 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-trusted-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731936 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731675 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4df38592-1b49-4e6a-958a-ac1b504e0839-image-registry-private-configuration\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.731936 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.731684 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4df38592-1b49-4e6a-958a-ac1b504e0839-registry-certificates\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:03.870465 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.870426 2557 generic.go:356] "Generic (PLEG): container finished" podID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerID="0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056" exitCode=0 Jul 09 15:31:03.870871 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.870477 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" Jul 09 15:31:03.870871 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.870504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" event={"ID":"4df38592-1b49-4e6a-958a-ac1b504e0839","Type":"ContainerDied","Data":"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056"} Jul 09 15:31:03.870871 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.870554 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d94cf94d8-bltbb" event={"ID":"4df38592-1b49-4e6a-958a-ac1b504e0839","Type":"ContainerDied","Data":"9db830b9f880e5a0a8daa7f6a0e35339b499db29abe97c8c623ddb4546c71cba"} Jul 09 15:31:03.870871 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.870591 2557 scope.go:117] "RemoveContainer" containerID="0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056" Jul 09 15:31:03.881730 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.881650 2557 scope.go:117] "RemoveContainer" containerID="0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056" Jul 09 15:31:03.882143 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:31:03.882098 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056\": container with ID starting with 0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056 not found: ID does not exist" containerID="0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056" Jul 09 15:31:03.882309 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.882156 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056"} err="failed to get container status \"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056\": rpc error: code = NotFound desc = could not find container \"0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056\": container with ID starting with 0cbac1e401dfdd03f145bf22bba1b6a800eeb82662b11ebdd97d782d1b874056 not found: ID does not exist" Jul 09 15:31:03.896461 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.896426 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:31:03.900761 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:03.900727 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d94cf94d8-bltbb"] Jul 09 15:31:04.795478 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:04.795448 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" path="/var/lib/kubelet/pods/4df38592-1b49-4e6a-958a-ac1b504e0839/volumes" Jul 09 15:31:05.881913 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:05.881877 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6kgcn" event={"ID":"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5","Type":"ContainerStarted","Data":"f9adecf59d9653e5b3858d31c283d59939f4ef45c3d084ac57a6987ba1ee2d30"} Jul 09 15:31:05.882417 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:05.881934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6kgcn" event={"ID":"9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5","Type":"ContainerStarted","Data":"686a4c131c3e58f57bf3bd10981188340361d1470e26a8c5f21f45e6e951ed56"} Jul 09 15:31:05.882417 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:05.882009 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:31:05.905038 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:05.904985 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6kgcn" podStartSLOduration=251.104611311 podStartE2EDuration="4m13.904965804s" totalImagesPullingTime="2.800354493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:05.903867156 +0000 UTC m=+289.682607966" watchObservedRunningTime="2026-07-09 15:31:05.904965804 +0000 UTC m=+289.683706614" Jul 09 15:31:06.523824 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.523791 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:31:06.561946 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.561915 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:31:06.562309 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.562294 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" Jul 09 15:31:06.562394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.562311 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" Jul 09 15:31:06.562394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.562356 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4df38592-1b49-4e6a-958a-ac1b504e0839" containerName="registry" Jul 09 15:31:06.577329 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.577298 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:31:06.577460 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.577406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659531 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659531 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnxw\" (UniqueName: \"kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659556 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659625 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.659817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.659640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760501 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760501 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760525 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnxw\" (UniqueName: \"kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.760757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.760698 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.761450 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.761393 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.761555 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.761429 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.761605 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.761579 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.762039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.762015 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.763326 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.763299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.763506 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.763487 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.772520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.772491 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnxw\" (UniqueName: \"kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw\") pod \"console-7957f88857-v6clj\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:06.785180 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.785097 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:06.785322 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.785195 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:06.795790 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.795766 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:06.889436 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.889405 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:06.892584 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:06.892560 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:07.039290 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:07.039263 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:31:07.041175 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:31:07.041152 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd373f6c_e035_4590_b201_86066506ab81.slice/crio-6bb59a45a8c2ffa54ceb68e78ed933b624eb7b8b4839f5a6870d6721248487a7 WatchSource:0}: Error finding container 6bb59a45a8c2ffa54ceb68e78ed933b624eb7b8b4839f5a6870d6721248487a7: Status 404 returned error can't find the container with id 6bb59a45a8c2ffa54ceb68e78ed933b624eb7b8b4839f5a6870d6721248487a7 Jul 09 15:31:07.890927 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:07.890889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7957f88857-v6clj" event={"ID":"dd373f6c-e035-4590-b201-86066506ab81","Type":"ContainerStarted","Data":"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38"} Jul 09 15:31:07.891339 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:07.890942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7957f88857-v6clj" event={"ID":"dd373f6c-e035-4590-b201-86066506ab81","Type":"ContainerStarted","Data":"6bb59a45a8c2ffa54ceb68e78ed933b624eb7b8b4839f5a6870d6721248487a7"} Jul 09 15:31:07.913991 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:07.913939 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7957f88857-v6clj" podStartSLOduration=1.9139212319999999 podStartE2EDuration="1.913921232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:07.912693165 +0000 UTC m=+291.691433976" watchObservedRunningTime="2026-07-09 15:31:07.913921232 +0000 UTC m=+291.692662042" Jul 09 15:31:15.888411 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:15.888367 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6kgcn" Jul 09 15:31:16.642369 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.642341 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:31:16.893048 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.892965 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:16.893048 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.893037 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:16.897707 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.897684 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:16.931418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.931389 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:31:16.982114 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:16.982078 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:31:31.545509 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.545431 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f95f6b794-p6gbn" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerName="console" containerID="cri-o://53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92" gracePeriod=15 Jul 09 15:31:31.785931 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.785902 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:31:31.871031 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.870935 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871031 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871017 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871279 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871047 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871279 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871065 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871279 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871088 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871279 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871115 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871279 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871139 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsbjr\" (UniqueName: \"kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr\") pod \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\" (UID: \"7e20e2eb-0bef-480d-8205-dcf1778c8e86\") " Jul 09 15:31:31.871584 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871552 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:31.871724 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871605 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:31.871724 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871613 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config" (OuterVolumeSpecName: "console-config") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:31.871724 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.871657 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:31.873616 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.873593 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:31.873715 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.873641 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr" (OuterVolumeSpecName: "kube-api-access-dsbjr") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "kube-api-access-dsbjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:31.873715 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.873652 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e20e2eb-0bef-480d-8205-dcf1778c8e86" (UID: "7e20e2eb-0bef-480d-8205-dcf1778c8e86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:31.972260 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972197 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972260 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972231 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972260 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972259 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972260 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972267 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972525 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972308 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsbjr\" (UniqueName: \"kubernetes.io/projected/7e20e2eb-0bef-480d-8205-dcf1778c8e86-kube-api-access-dsbjr\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972525 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972317 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e20e2eb-0bef-480d-8205-dcf1778c8e86-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.972525 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.972326 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e20e2eb-0bef-480d-8205-dcf1778c8e86-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:31.986343 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.986305 2557 generic.go:356] "Generic (PLEG): container finished" podID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerID="53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92" exitCode=0 Jul 09 15:31:31.986514 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.986339 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f95f6b794-p6gbn" event={"ID":"7e20e2eb-0bef-480d-8205-dcf1778c8e86","Type":"ContainerDied","Data":"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92"} Jul 09 15:31:31.986514 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.986400 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f95f6b794-p6gbn" event={"ID":"7e20e2eb-0bef-480d-8205-dcf1778c8e86","Type":"ContainerDied","Data":"a450dbc511199cd87be515b0584457bd575c81d609a518b2a88856aa17d155c8"} Jul 09 15:31:31.986514 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.986420 2557 scope.go:117] "RemoveContainer" containerID="53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92" Jul 09 15:31:31.986514 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.986352 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f95f6b794-p6gbn" Jul 09 15:31:31.995066 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.995047 2557 scope.go:117] "RemoveContainer" containerID="53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92" Jul 09 15:31:31.995389 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:31:31.995370 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92\": container with ID starting with 53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92 not found: ID does not exist" containerID="53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92" Jul 09 15:31:31.995456 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:31.995398 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92"} err="failed to get container status \"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92\": rpc error: code = NotFound desc = could not find container \"53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92\": container with ID starting with 53277bd812a3e266bb92688da7065a3cd0c2dee1308204d9fa715be9483cfa92 not found: ID does not exist" Jul 09 15:31:32.009193 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:32.009154 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:31:32.013773 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:32.013744 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f95f6b794-p6gbn"] Jul 09 15:31:32.793993 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:32.793953 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" path="/var/lib/kubelet/pods/7e20e2eb-0bef-480d-8205-dcf1778c8e86/volumes" Jul 09 15:31:42.003155 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.003112 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66dc4644c8-cnlqz" podUID="c6e847c1-135d-463a-8e53-1c24cd29e848" containerName="console" containerID="cri-o://e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3" gracePeriod=15 Jul 09 15:31:42.251963 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.251937 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:42.357037 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.356996 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357219 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357048 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357219 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357091 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357219 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357202 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357280 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357325 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btqnn\" (UniqueName: \"kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357354 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert\") pod \"c6e847c1-135d-463a-8e53-1c24cd29e848\" (UID: \"c6e847c1-135d-463a-8e53-1c24cd29e848\") " Jul 09 15:31:42.357611 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357569 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:42.357611 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357590 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:42.357816 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357783 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config" (OuterVolumeSpecName: "console-config") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:42.358089 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.357902 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:42.359555 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.359523 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn" (OuterVolumeSpecName: "kube-api-access-btqnn") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "kube-api-access-btqnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:42.359555 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.359541 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:42.359673 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.359565 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6e847c1-135d-463a-8e53-1c24cd29e848" (UID: "c6e847c1-135d-463a-8e53-1c24cd29e848"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:42.458887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458849 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.458887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458880 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.458887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458890 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.458887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458898 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.459226 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458908 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btqnn\" (UniqueName: \"kubernetes.io/projected/c6e847c1-135d-463a-8e53-1c24cd29e848-kube-api-access-btqnn\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.459226 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458916 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e847c1-135d-463a-8e53-1c24cd29e848-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:42.459226 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:42.458926 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6e847c1-135d-463a-8e53-1c24cd29e848-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:31:43.035715 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.035682 2557 generic.go:356] "Generic (PLEG): container finished" podID="c6e847c1-135d-463a-8e53-1c24cd29e848" containerID="e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3" exitCode=0 Jul 09 15:31:43.036124 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.035734 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc4644c8-cnlqz" Jul 09 15:31:43.036124 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.035776 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc4644c8-cnlqz" event={"ID":"c6e847c1-135d-463a-8e53-1c24cd29e848","Type":"ContainerDied","Data":"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3"} Jul 09 15:31:43.036124 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.035834 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc4644c8-cnlqz" event={"ID":"c6e847c1-135d-463a-8e53-1c24cd29e848","Type":"ContainerDied","Data":"fa337890b95e1df839b9d368e328796605809988649a50d011e6557190ddb382"} Jul 09 15:31:43.036124 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.035857 2557 scope.go:117] "RemoveContainer" containerID="e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3" Jul 09 15:31:43.045912 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.045077 2557 scope.go:117] "RemoveContainer" containerID="e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3" Jul 09 15:31:43.046390 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:31:43.046362 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3\": container with ID starting with e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3 not found: ID does not exist" containerID="e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3" Jul 09 15:31:43.046465 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.046404 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3"} err="failed to get container status \"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3\": rpc error: code = NotFound desc = could not find container \"e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3\": container with ID starting with e63c52645073ca4ba5b6b1f3b388d0a31ab0485e1aad71b055b741d0ccf83ab3 not found: ID does not exist" Jul 09 15:31:43.058405 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.058334 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:31:43.062320 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:43.062293 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66dc4644c8-cnlqz"] Jul 09 15:31:44.798025 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:31:44.797978 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e847c1-135d-463a-8e53-1c24cd29e848" path="/var/lib/kubelet/pods/c6e847c1-135d-463a-8e53-1c24cd29e848/volumes" Jul 09 15:32:32.524712 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.524679 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.524969 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerName="console" Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.524980 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerName="console" Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.524992 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e847c1-135d-463a-8e53-1c24cd29e848" containerName="console" Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.524997 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e847c1-135d-463a-8e53-1c24cd29e848" containerName="console" Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.525064 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e847c1-135d-463a-8e53-1c24cd29e848" containerName="console" Jul 09 15:32:32.525123 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.525072 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e20e2eb-0bef-480d-8205-dcf1778c8e86" containerName="console" Jul 09 15:32:32.527635 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.527606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.539984 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.539956 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:32:32.563681 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.563902 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.563902 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.563902 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563809 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.563902 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7h4l\" (UniqueName: \"kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.564121 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.564121 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.563972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665190 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7h4l\" (UniqueName: \"kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665388 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.665634 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.665495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.666169 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.666144 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.666169 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.666161 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.666344 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.666328 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.666716 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.666692 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.667977 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.667954 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.668115 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.668096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.674566 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.674537 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7h4l\" (UniqueName: \"kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l\") pod \"console-888bb54cc-cbkn9\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.836835 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.836739 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:32.976327 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:32.976127 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:32:32.978981 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:32:32.978944 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2fde15_3459_4ab7_9fd0_ab326d43a39c.slice/crio-0bc0a6fe8bf3ac812febdc9904ef4bf001f58f3cb3cf2efc05fd4d73cfb0f6f5 WatchSource:0}: Error finding container 0bc0a6fe8bf3ac812febdc9904ef4bf001f58f3cb3cf2efc05fd4d73cfb0f6f5: Status 404 returned error can't find the container with id 0bc0a6fe8bf3ac812febdc9904ef4bf001f58f3cb3cf2efc05fd4d73cfb0f6f5 Jul 09 15:32:33.223394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:33.223295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-888bb54cc-cbkn9" event={"ID":"be2fde15-3459-4ab7-9fd0-ab326d43a39c","Type":"ContainerStarted","Data":"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740"} Jul 09 15:32:33.223394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:33.223357 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-888bb54cc-cbkn9" event={"ID":"be2fde15-3459-4ab7-9fd0-ab326d43a39c","Type":"ContainerStarted","Data":"0bc0a6fe8bf3ac812febdc9904ef4bf001f58f3cb3cf2efc05fd4d73cfb0f6f5"} Jul 09 15:32:33.243283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:33.243208 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-888bb54cc-cbkn9" podStartSLOduration=1.243189202 podStartE2EDuration="1.243189202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:33.241845895 +0000 UTC m=+377.020586738" watchObservedRunningTime="2026-07-09 15:32:33.243189202 +0000 UTC m=+377.021930040" Jul 09 15:32:42.837795 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:42.837745 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:42.838208 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:42.837851 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:42.842665 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:42.842639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:43.263085 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:43.263010 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:32:43.311738 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:32:43.311692 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:33:08.337532 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.337488 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7957f88857-v6clj" podUID="dd373f6c-e035-4590-b201-86066506ab81" containerName="console" containerID="cri-o://89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38" gracePeriod=15 Jul 09 15:33:08.581732 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.581707 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:33:08.666936 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.666831 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.666936 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.666923 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667167 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.666961 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667167 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.666983 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmnxw\" (UniqueName: \"kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667167 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667006 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667167 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667042 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667167 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667071 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config\") pod \"dd373f6c-e035-4590-b201-86066506ab81\" (UID: \"dd373f6c-e035-4590-b201-86066506ab81\") " Jul 09 15:33:08.667504 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667476 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:08.667826 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667546 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:08.667826 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667598 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:08.667826 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.667689 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config" (OuterVolumeSpecName: "console-config") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:08.669262 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.669218 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw" (OuterVolumeSpecName: "kube-api-access-jmnxw") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "kube-api-access-jmnxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:08.669349 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.669276 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:08.669349 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.669296 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd373f6c-e035-4590-b201-86066506ab81" (UID: "dd373f6c-e035-4590-b201-86066506ab81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:08.767798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767756 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.767798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767791 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.767798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767800 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmnxw\" (UniqueName: \"kubernetes.io/projected/dd373f6c-e035-4590-b201-86066506ab81-kube-api-access-jmnxw\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.767798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767809 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.768054 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767817 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.768054 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767827 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd373f6c-e035-4590-b201-86066506ab81-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:08.768054 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:08.767835 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd373f6c-e035-4590-b201-86066506ab81-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:33:09.362351 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.362304 2557 generic.go:356] "Generic (PLEG): container finished" podID="dd373f6c-e035-4590-b201-86066506ab81" containerID="89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38" exitCode=0 Jul 09 15:33:09.362762 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.362375 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7957f88857-v6clj" Jul 09 15:33:09.362762 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.362396 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7957f88857-v6clj" event={"ID":"dd373f6c-e035-4590-b201-86066506ab81","Type":"ContainerDied","Data":"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38"} Jul 09 15:33:09.362762 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.362456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7957f88857-v6clj" event={"ID":"dd373f6c-e035-4590-b201-86066506ab81","Type":"ContainerDied","Data":"6bb59a45a8c2ffa54ceb68e78ed933b624eb7b8b4839f5a6870d6721248487a7"} Jul 09 15:33:09.362762 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.362479 2557 scope.go:117] "RemoveContainer" containerID="89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38" Jul 09 15:33:09.370671 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.370647 2557 scope.go:117] "RemoveContainer" containerID="89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38" Jul 09 15:33:09.370956 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:33:09.370938 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38\": container with ID starting with 89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38 not found: ID does not exist" containerID="89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38" Jul 09 15:33:09.371013 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.370965 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38"} err="failed to get container status \"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38\": rpc error: code = NotFound desc = could not find container \"89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38\": container with ID starting with 89ae1765ed22cf775398b3bdd458adc52b0d166e37b3392c5c9d695c5a4ffa38 not found: ID does not exist" Jul 09 15:33:09.380944 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.380905 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:33:09.387342 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:09.387316 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7957f88857-v6clj"] Jul 09 15:33:10.794041 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:10.794007 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd373f6c-e035-4590-b201-86066506ab81" path="/var/lib/kubelet/pods/dd373f6c-e035-4590-b201-86066506ab81/volumes" Jul 09 15:33:25.809850 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.809817 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv"] Jul 09 15:33:25.810286 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.810185 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd373f6c-e035-4590-b201-86066506ab81" containerName="console" Jul 09 15:33:25.810286 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.810201 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd373f6c-e035-4590-b201-86066506ab81" containerName="console" Jul 09 15:33:25.810369 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.810296 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd373f6c-e035-4590-b201-86066506ab81" containerName="console" Jul 09 15:33:25.813330 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.813311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.816394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.816371 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 15:33:25.816494 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.816420 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 15:33:25.817582 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.817558 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mjrvs\"" Jul 09 15:33:25.824379 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.824356 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv"] Jul 09 15:33:25.897664 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.897627 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.897848 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.897675 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.897848 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.897741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87gc5\" (UniqueName: \"kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.998646 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.998607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.998844 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.998659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87gc5\" (UniqueName: \"kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.998844 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.998695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.999024 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.999001 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:25.999076 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:25.999027 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:26.008914 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:26.008884 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87gc5\" (UniqueName: \"kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:26.122818 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:26.122700 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:33:26.260614 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:26.260582 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv"] Jul 09 15:33:26.264510 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:33:26.264471 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e73caf_ec39_4cd5_8268_f7cbf515bb72.slice/crio-aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd WatchSource:0}: Error finding container aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd: Status 404 returned error can't find the container with id aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd Jul 09 15:33:26.266790 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:26.266773 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:33:26.431952 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:26.431868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" event={"ID":"b1e73caf-ec39-4cd5-8268-f7cbf515bb72","Type":"ContainerStarted","Data":"aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd"} Jul 09 15:33:34.465493 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:34.465396 2557 generic.go:356] "Generic (PLEG): container finished" podID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerID="8a165e39e140ac1b8d0f6987ac3ef870b862c1fa881dd72c10d4eb0a8fef58d1" exitCode=0 Jul 09 15:33:34.465493 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:34.465445 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" event={"ID":"b1e73caf-ec39-4cd5-8268-f7cbf515bb72","Type":"ContainerDied","Data":"8a165e39e140ac1b8d0f6987ac3ef870b862c1fa881dd72c10d4eb0a8fef58d1"} Jul 09 15:33:52.532669 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:52.532621 2557 generic.go:356] "Generic (PLEG): container finished" podID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerID="41d838c66751ececbec9594e55320d49acd65225034727c46d7d8c52c900c59b" exitCode=0 Jul 09 15:33:52.533069 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:52.532701 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" event={"ID":"b1e73caf-ec39-4cd5-8268-f7cbf515bb72","Type":"ContainerDied","Data":"41d838c66751ececbec9594e55320d49acd65225034727c46d7d8c52c900c59b"} Jul 09 15:33:59.563198 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:59.563165 2557 generic.go:356] "Generic (PLEG): container finished" podID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerID="0babd68e92d1248ed9dc3247f9f8d306a1f4ac1d0f66d4c18019d20458d21e19" exitCode=0 Jul 09 15:33:59.563586 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:33:59.563219 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" event={"ID":"b1e73caf-ec39-4cd5-8268-f7cbf515bb72","Type":"ContainerDied","Data":"0babd68e92d1248ed9dc3247f9f8d306a1f4ac1d0f66d4c18019d20458d21e19"} Jul 09 15:34:00.695325 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.695299 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:34:00.782177 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.782137 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87gc5\" (UniqueName: \"kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5\") pod \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " Jul 09 15:34:00.782377 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.782216 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle\") pod \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " Jul 09 15:34:00.782377 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.782324 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util\") pod \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\" (UID: \"b1e73caf-ec39-4cd5-8268-f7cbf515bb72\") " Jul 09 15:34:00.782840 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.782819 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle" (OuterVolumeSpecName: "bundle") pod "b1e73caf-ec39-4cd5-8268-f7cbf515bb72" (UID: "b1e73caf-ec39-4cd5-8268-f7cbf515bb72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:34:00.784564 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.784543 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5" (OuterVolumeSpecName: "kube-api-access-87gc5") pod "b1e73caf-ec39-4cd5-8268-f7cbf515bb72" (UID: "b1e73caf-ec39-4cd5-8268-f7cbf515bb72"). InnerVolumeSpecName "kube-api-access-87gc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:34:00.789265 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.789218 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util" (OuterVolumeSpecName: "util") pod "b1e73caf-ec39-4cd5-8268-f7cbf515bb72" (UID: "b1e73caf-ec39-4cd5-8268-f7cbf515bb72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:34:00.883381 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.883288 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:34:00.883381 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.883316 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-util\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:34:00.883381 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:00.883325 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87gc5\" (UniqueName: \"kubernetes.io/projected/b1e73caf-ec39-4cd5-8268-f7cbf515bb72-kube-api-access-87gc5\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:34:01.572334 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:01.572292 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" Jul 09 15:34:01.572518 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:01.572297 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589smzsv" event={"ID":"b1e73caf-ec39-4cd5-8268-f7cbf515bb72","Type":"ContainerDied","Data":"aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd"} Jul 09 15:34:01.572518 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:01.572421 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa8bbf1500d089cf2bf93356e2d13ed25ab97c40948ba1861e236feabda790dd" Jul 09 15:34:04.261192 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261160 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc"] Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261473 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="util" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261485 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="util" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261510 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="pull" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261515 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="pull" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261530 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="extract" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261535 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="extract" Jul 09 15:34:04.261718 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.261580 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e73caf-ec39-4cd5-8268-f7cbf515bb72" containerName="extract" Jul 09 15:34:04.263461 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.263444 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.268797 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.268772 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-m9dkg\"" Jul 09 15:34:04.269039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.268843 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 09 15:34:04.269039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.268850 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 09 15:34:04.269039 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.268864 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 09 15:34:04.285639 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.285609 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc"] Jul 09 15:34:04.414478 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.414438 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e1bfa9d-c454-4ccd-b944-594aac133e94-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.414478 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.414483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8v6\" (UniqueName: \"kubernetes.io/projected/6e1bfa9d-c454-4ccd-b944-594aac133e94-kube-api-access-hk8v6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.515694 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.515596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e1bfa9d-c454-4ccd-b944-594aac133e94-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.515694 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.515641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8v6\" (UniqueName: \"kubernetes.io/projected/6e1bfa9d-c454-4ccd-b944-594aac133e94-kube-api-access-hk8v6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.518290 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.518256 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e1bfa9d-c454-4ccd-b944-594aac133e94-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.525861 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.525836 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8v6\" (UniqueName: \"kubernetes.io/projected/6e1bfa9d-c454-4ccd-b944-594aac133e94-kube-api-access-hk8v6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-r28bc\" (UID: \"6e1bfa9d-c454-4ccd-b944-594aac133e94\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.574008 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.573971 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:04.715026 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:04.714905 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc"] Jul 09 15:34:04.719017 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:34:04.718987 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1bfa9d_c454_4ccd_b944_594aac133e94.slice/crio-f25d6a26d3f6dd5316b41bcdd8e189d03ab456589380794b2f13a1bf785964dc WatchSource:0}: Error finding container f25d6a26d3f6dd5316b41bcdd8e189d03ab456589380794b2f13a1bf785964dc: Status 404 returned error can't find the container with id f25d6a26d3f6dd5316b41bcdd8e189d03ab456589380794b2f13a1bf785964dc Jul 09 15:34:05.589839 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:05.589801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" event={"ID":"6e1bfa9d-c454-4ccd-b944-594aac133e94","Type":"ContainerStarted","Data":"f25d6a26d3f6dd5316b41bcdd8e189d03ab456589380794b2f13a1bf785964dc"} Jul 09 15:34:08.603950 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.603912 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" event={"ID":"6e1bfa9d-c454-4ccd-b944-594aac133e94","Type":"ContainerStarted","Data":"3adf12fdd1c1ad83f53d5866b1827dd8f88c39a79787806cd029c4d579ad2415"} Jul 09 15:34:08.604425 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.604011 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:08.628065 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.628001 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" podStartSLOduration=1.3016342459999999 podStartE2EDuration="4.627977816s" totalImagesPullingTime="3.32634357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:08.627144219 +0000 UTC m=+472.405885030" watchObservedRunningTime="2026-07-09 15:34:08.627977816 +0000 UTC m=+472.406718626" Jul 09 15:34:08.773395 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.773359 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-f9v95"] Jul 09 15:34:08.776564 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.776542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.779340 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.779321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 09 15:34:08.779495 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.779478 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 09 15:34:08.779573 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.779556 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-ftdpr\"" Jul 09 15:34:08.799277 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.796332 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-f9v95"] Jul 09 15:34:08.855942 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.855845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpx9v\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-kube-api-access-bpx9v\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.855942 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.855888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.855942 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.855921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-cabundle0\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.957110 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.957072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpx9v\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-kube-api-access-bpx9v\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.957314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.957124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.957314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.957156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-cabundle0\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.957407 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:08.957323 2557 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 09 15:34:08.957407 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:08.957352 2557 secret.go:281] references non-existent secret key: ca.crt Jul 09 15:34:08.957407 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:08.957363 2557 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 09 15:34:08.957407 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:08.957396 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-f9v95: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 15:34:08.957555 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:08.957466 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates podName:2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca nodeName:}" failed. No retries permitted until 2026-07-09 15:34:09.457444973 +0000 UTC m=+473.236185762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates") pod "keda-operator-68bff59c-f9v95" (UID: "2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 15:34:08.957901 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.957882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-cabundle0\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:08.970907 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:08.970878 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpx9v\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-kube-api-access-bpx9v\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:09.005805 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.005767 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xg474"] Jul 09 15:34:09.009129 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.009107 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.013335 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.013314 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 09 15:34:09.022927 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.022896 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xg474"] Jul 09 15:34:09.158402 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.158289 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3d910854-d326-49a7-8c9f-6cb54c745468-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.158402 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.158374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.158619 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.158405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8ds\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-kube-api-access-5s8ds\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.258870 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.258822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3d910854-d326-49a7-8c9f-6cb54c745468-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.259060 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.258898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.259060 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.258926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8ds\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-kube-api-access-5s8ds\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.259060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.259007 2557 secret.go:281] references non-existent secret key: tls.crt Jul 09 15:34:09.259060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.259031 2557 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 09 15:34:09.259060 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.259054 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-xg474: references non-existent secret key: tls.crt Jul 09 15:34:09.259267 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.259121 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates podName:3d910854-d326-49a7-8c9f-6cb54c745468 nodeName:}" failed. No retries permitted until 2026-07-09 15:34:09.759101208 +0000 UTC m=+473.537841998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates") pod "keda-metrics-apiserver-559f75f947-xg474" (UID: "3d910854-d326-49a7-8c9f-6cb54c745468") : references non-existent secret key: tls.crt Jul 09 15:34:09.259335 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.259319 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3d910854-d326-49a7-8c9f-6cb54c745468-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.271441 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.271415 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8ds\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-kube-api-access-5s8ds\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.461010 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.460923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:09.463505 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.463480 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca-certificates\") pod \"keda-operator-68bff59c-f9v95\" (UID: \"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca\") " pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:09.582775 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.582732 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-skgpl"] Jul 09 15:34:09.586150 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.586124 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.588974 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.588945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 09 15:34:09.595539 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.595510 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-skgpl"] Jul 09 15:34:09.662504 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.662468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97xt\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-kube-api-access-l97xt\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.662504 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.662516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.686422 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.686387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:09.763798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.763765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.763798 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.763800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97xt\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-kube-api-access-l97xt\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.763998 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.763831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.763998 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.763921 2557 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 09 15:34:09.763998 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.763937 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-skgpl: secret "keda-admission-webhooks-certs" not found Jul 09 15:34:09.763998 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:34:09.763983 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates podName:eecf3b28-ddfb-409c-a219-c243cf300dcd nodeName:}" failed. No retries permitted until 2026-07-09 15:34:10.263968531 +0000 UTC m=+474.042709320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates") pod "keda-admission-5fbd5c4644-skgpl" (UID: "eecf3b28-ddfb-409c-a219-c243cf300dcd") : secret "keda-admission-webhooks-certs" not found Jul 09 15:34:09.766744 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.766711 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3d910854-d326-49a7-8c9f-6cb54c745468-certificates\") pod \"keda-metrics-apiserver-559f75f947-xg474\" (UID: \"3d910854-d326-49a7-8c9f-6cb54c745468\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:09.780264 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.780212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97xt\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-kube-api-access-l97xt\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:09.828381 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.828293 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-f9v95"] Jul 09 15:34:09.830851 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:34:09.830815 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2a97d6_0a7c_4d11_b2ac_a8b28086d8ca.slice/crio-82fe47f77ac5f5d9b2151888b2d9ac112e3b5297a218a2c5fb331c57458b1809 WatchSource:0}: Error finding container 82fe47f77ac5f5d9b2151888b2d9ac112e3b5297a218a2c5fb331c57458b1809: Status 404 returned error can't find the container with id 82fe47f77ac5f5d9b2151888b2d9ac112e3b5297a218a2c5fb331c57458b1809 Jul 09 15:34:09.919859 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:09.919824 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:10.060930 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.060797 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xg474"] Jul 09 15:34:10.063075 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:34:10.063050 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d910854_d326_49a7_8c9f_6cb54c745468.slice/crio-1a29a4261812736a410cbf4f6d8aa8b82ef1d1638befe7c95171743a281fa5a9 WatchSource:0}: Error finding container 1a29a4261812736a410cbf4f6d8aa8b82ef1d1638befe7c95171743a281fa5a9: Status 404 returned error can't find the container with id 1a29a4261812736a410cbf4f6d8aa8b82ef1d1638befe7c95171743a281fa5a9 Jul 09 15:34:10.268097 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.268071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:10.270935 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.270902 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eecf3b28-ddfb-409c-a219-c243cf300dcd-certificates\") pod \"keda-admission-5fbd5c4644-skgpl\" (UID: \"eecf3b28-ddfb-409c-a219-c243cf300dcd\") " pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:10.497679 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.497646 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:10.616710 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.616671 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" event={"ID":"3d910854-d326-49a7-8c9f-6cb54c745468","Type":"ContainerStarted","Data":"1a29a4261812736a410cbf4f6d8aa8b82ef1d1638befe7c95171743a281fa5a9"} Jul 09 15:34:10.618177 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.618147 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-f9v95" event={"ID":"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca","Type":"ContainerStarted","Data":"82fe47f77ac5f5d9b2151888b2d9ac112e3b5297a218a2c5fb331c57458b1809"} Jul 09 15:34:10.706232 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:10.706026 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-skgpl"] Jul 09 15:34:10.709678 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:34:10.709643 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecf3b28_ddfb_409c_a219_c243cf300dcd.slice/crio-a848c87ae1598e16056bdf84b1565d34ac7ea8c6489ccef95795f436789aefb6 WatchSource:0}: Error finding container a848c87ae1598e16056bdf84b1565d34ac7ea8c6489ccef95795f436789aefb6: Status 404 returned error can't find the container with id a848c87ae1598e16056bdf84b1565d34ac7ea8c6489ccef95795f436789aefb6 Jul 09 15:34:11.625392 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:11.625352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" event={"ID":"eecf3b28-ddfb-409c-a219-c243cf300dcd","Type":"ContainerStarted","Data":"a848c87ae1598e16056bdf84b1565d34ac7ea8c6489ccef95795f436789aefb6"} Jul 09 15:34:14.640559 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.640523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" event={"ID":"eecf3b28-ddfb-409c-a219-c243cf300dcd","Type":"ContainerStarted","Data":"b556929e5d6d329d21774be9fc35d9ab50fd4be6a42832a50d287f8a3ade7d93"} Jul 09 15:34:14.641004 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.640639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:34:14.642092 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.642065 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" event={"ID":"3d910854-d326-49a7-8c9f-6cb54c745468","Type":"ContainerStarted","Data":"a98e28d19963e68f2d236f0b8f44b5a0692453491385ff9fd064760041bb32ab"} Jul 09 15:34:14.642188 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.642117 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:14.643452 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.643429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-f9v95" event={"ID":"2e2a97d6-0a7c-4d11-b2ac-a8b28086d8ca","Type":"ContainerStarted","Data":"40a4ae2b3a7ef3daa6300582b8d544ae5a8afffc75637230b197394690962441"} Jul 09 15:34:14.643573 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.643558 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:14.659439 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.659369 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" podStartSLOduration=2.393420278 podStartE2EDuration="5.659351838s" totalImagesPullingTime="3.26593156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:14.659109191 +0000 UTC m=+478.437850001" watchObservedRunningTime="2026-07-09 15:34:14.659351838 +0000 UTC m=+478.438092648" Jul 09 15:34:14.677378 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.677321 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" podStartSLOduration=2.764951153 podStartE2EDuration="6.677303007s" totalImagesPullingTime="3.912351854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:14.676410276 +0000 UTC m=+478.455151107" watchObservedRunningTime="2026-07-09 15:34:14.677303007 +0000 UTC m=+478.456043816" Jul 09 15:34:14.695686 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:14.695630 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-f9v95" podStartSLOduration=2.540198234 podStartE2EDuration="6.695613222s" totalImagesPullingTime="4.155414988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:14.694627249 +0000 UTC m=+478.473368082" watchObservedRunningTime="2026-07-09 15:34:14.695613222 +0000 UTC m=+478.474354045" Jul 09 15:34:25.652397 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:25.652368 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xg474" Jul 09 15:34:29.610840 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:29.610806 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-r28bc" Jul 09 15:34:35.649762 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:35.649730 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-f9v95" Jul 09 15:34:35.650283 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:34:35.649805 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-skgpl" Jul 09 15:35:16.338613 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.338576 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:16.340674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.340653 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.343640 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.343612 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h4k6k"] Jul 09 15:35:16.343748 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.343670 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 15:35:16.344674 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.344656 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 15:35:16.344756 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.344658 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-tjwgh\"" Jul 09 15:35:16.344969 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.344953 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 15:35:16.345578 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.345563 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.357191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.357170 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-nplvl\"" Jul 09 15:35:16.357431 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.357416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 09 15:35:16.359920 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.359894 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:16.367040 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.367014 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h4k6k"] Jul 09 15:35:16.417405 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.417371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21e0eb4-55d1-410d-8bf9-4899362ed028-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.417583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.417431 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2stgn\" (UniqueName: \"kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.417583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.417455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.417583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.417480 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5zf\" (UniqueName: \"kubernetes.io/projected/c21e0eb4-55d1-410d-8bf9-4899362ed028-kube-api-access-7q5zf\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.518024 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.517978 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5zf\" (UniqueName: \"kubernetes.io/projected/c21e0eb4-55d1-410d-8bf9-4899362ed028-kube-api-access-7q5zf\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.518203 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.518047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21e0eb4-55d1-410d-8bf9-4899362ed028-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.518203 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.518113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2stgn\" (UniqueName: \"kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.518203 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.518143 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.518366 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:16.518279 2557 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 15:35:16.518366 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:16.518344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert podName:4223fb29-e229-4a22-bac1-d523db36797a nodeName:}" failed. No retries permitted until 2026-07-09 15:35:17.018323241 +0000 UTC m=+540.797064028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert") pod "kserve-controller-manager-799c68cd74-dqccd" (UID: "4223fb29-e229-4a22-bac1-d523db36797a") : secret "kserve-webhook-server-cert" not found Jul 09 15:35:16.520763 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.520741 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21e0eb4-55d1-410d-8bf9-4899362ed028-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.533732 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.533694 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5zf\" (UniqueName: \"kubernetes.io/projected/c21e0eb4-55d1-410d-8bf9-4899362ed028-kube-api-access-7q5zf\") pod \"llmisvc-controller-manager-67d95fdc48-h4k6k\" (UID: \"c21e0eb4-55d1-410d-8bf9-4899362ed028\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.534791 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.534756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2stgn\" (UniqueName: \"kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:16.662500 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.662412 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-nplvl\"" Jul 09 15:35:16.669933 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.669903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:16.808257 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.808203 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h4k6k"] Jul 09 15:35:16.811689 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:35:16.811662 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc21e0eb4_55d1_410d_8bf9_4899362ed028.slice/crio-f11021cd0d63ea9d12c3229d388c20daeb2c0d74aa55f7b28cd1bc84e7172f50 WatchSource:0}: Error finding container f11021cd0d63ea9d12c3229d388c20daeb2c0d74aa55f7b28cd1bc84e7172f50: Status 404 returned error can't find the container with id f11021cd0d63ea9d12c3229d388c20daeb2c0d74aa55f7b28cd1bc84e7172f50 Jul 09 15:35:16.903075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:16.903039 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" event={"ID":"c21e0eb4-55d1-410d-8bf9-4899362ed028","Type":"ContainerStarted","Data":"f11021cd0d63ea9d12c3229d388c20daeb2c0d74aa55f7b28cd1bc84e7172f50"} Jul 09 15:35:17.022477 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.022447 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:17.025189 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.025152 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") pod \"kserve-controller-manager-799c68cd74-dqccd\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:17.255844 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.255806 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-tjwgh\"" Jul 09 15:35:17.263428 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.263395 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:17.664950 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.664921 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:17.750142 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:35:17.750105 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4223fb29_e229_4a22_bac1_d523db36797a.slice/crio-92ec4b69d84058fa241da4d163523122f7f246db1bb66abc69dd3064d3d22efc WatchSource:0}: Error finding container 92ec4b69d84058fa241da4d163523122f7f246db1bb66abc69dd3064d3d22efc: Status 404 returned error can't find the container with id 92ec4b69d84058fa241da4d163523122f7f246db1bb66abc69dd3064d3d22efc Jul 09 15:35:17.907863 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:17.907830 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerStarted","Data":"92ec4b69d84058fa241da4d163523122f7f246db1bb66abc69dd3064d3d22efc"} Jul 09 15:35:19.918980 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:19.918945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" event={"ID":"c21e0eb4-55d1-410d-8bf9-4899362ed028","Type":"ContainerStarted","Data":"3259546f6b5a6c39f4a438bf810290f3014cb16c301f839dd51d63e033531545"} Jul 09 15:35:19.919417 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:19.919151 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:19.942074 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:19.941965 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" podStartSLOduration=1.076676265 podStartE2EDuration="3.941949516s" totalImagesPullingTime="2.865273251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:35:19.940295666 +0000 UTC m=+543.719036482" watchObservedRunningTime="2026-07-09 15:35:19.941949516 +0000 UTC m=+543.720690325" Jul 09 15:35:20.924678 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:20.924633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerStarted","Data":"143bf7e2844a17b8e551d3305f51e3c0e9e5005b70429fb542c47d88ae8493dc"} Jul 09 15:35:20.925170 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:20.924697 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:20.956133 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:20.956076 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podStartSLOduration=1.912720099 podStartE2EDuration="4.956060237s" totalImagesPullingTime="3.043340138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:35:20.953359809 +0000 UTC m=+544.732100618" watchObservedRunningTime="2026-07-09 15:35:20.956060237 +0000 UTC m=+544.734801046" Jul 09 15:35:21.929999 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:21.929957 2557 generic.go:356] "Generic (PLEG): container finished" podID="4223fb29-e229-4a22-bac1-d523db36797a" containerID="143bf7e2844a17b8e551d3305f51e3c0e9e5005b70429fb542c47d88ae8493dc" exitCode=1 Jul 09 15:35:21.930480 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:21.930049 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerDied","Data":"143bf7e2844a17b8e551d3305f51e3c0e9e5005b70429fb542c47d88ae8493dc"} Jul 09 15:35:21.930480 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:21.930311 2557 scope.go:117] "RemoveContainer" containerID="143bf7e2844a17b8e551d3305f51e3c0e9e5005b70429fb542c47d88ae8493dc" Jul 09 15:35:22.935620 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:22.935579 2557 generic.go:356] "Generic (PLEG): container finished" podID="4223fb29-e229-4a22-bac1-d523db36797a" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" exitCode=1 Jul 09 15:35:22.936061 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:22.935667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerDied","Data":"bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541"} Jul 09 15:35:22.936061 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:22.935727 2557 scope.go:117] "RemoveContainer" containerID="143bf7e2844a17b8e551d3305f51e3c0e9e5005b70429fb542c47d88ae8493dc" Jul 09 15:35:22.936061 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:22.935900 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:22.936172 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:22.936119 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:23.941921 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:23.941882 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:23.942320 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:23.942079 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:25.924879 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:25.924838 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:25.925389 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:25.925341 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:25.925563 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:25.925540 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:27.264229 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:27.264183 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:27.264641 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:27.264591 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:27.264780 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:27.264758 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:42.789624 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:42.789584 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:44.026224 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:44.026186 2557 generic.go:356] "Generic (PLEG): container finished" podID="4223fb29-e229-4a22-bac1-d523db36797a" containerID="e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87" exitCode=1 Jul 09 15:35:44.026661 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:44.026259 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerDied","Data":"e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87"} Jul 09 15:35:44.026661 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:44.026320 2557 scope.go:117] "RemoveContainer" containerID="bd79a61195855f5cade24ae470940b9f61c1d47b3a71614d81bbfe5509a90541" Jul 09 15:35:44.026745 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:44.026690 2557 scope.go:117] "RemoveContainer" containerID="e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87" Jul 09 15:35:44.026906 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:44.026885 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:45.925727 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:45.925689 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:45.926104 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:45.926019 2557 scope.go:117] "RemoveContainer" containerID="e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87" Jul 09 15:35:45.926259 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:45.926221 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:47.264118 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:47.264074 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:47.264550 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:47.264509 2557 scope.go:117] "RemoveContainer" containerID="e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87" Jul 09 15:35:47.264707 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:47.264687 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-dqccd_kserve(4223fb29-e229-4a22-bac1-d523db36797a)\"" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" podUID="4223fb29-e229-4a22-bac1-d523db36797a" Jul 09 15:35:50.927502 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:50.927458 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h4k6k" Jul 09 15:35:52.641184 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.641134 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:52.665553 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.665518 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-rhbj8"] Jul 09 15:35:52.670464 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.670439 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.679619 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.679588 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-rhbj8"] Jul 09 15:35:52.714856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.714822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/580effc2-e723-4144-b7ac-e15a3e9b0a5d-cert\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.715019 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.714892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtc5t\" (UniqueName: \"kubernetes.io/projected/580effc2-e723-4144-b7ac-e15a3e9b0a5d-kube-api-access-gtc5t\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.777309 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.777285 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:52.815934 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.815892 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") pod \"4223fb29-e229-4a22-bac1-d523db36797a\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " Jul 09 15:35:52.816216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.815950 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2stgn\" (UniqueName: \"kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn\") pod \"4223fb29-e229-4a22-bac1-d523db36797a\" (UID: \"4223fb29-e229-4a22-bac1-d523db36797a\") " Jul 09 15:35:52.816216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.816041 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtc5t\" (UniqueName: \"kubernetes.io/projected/580effc2-e723-4144-b7ac-e15a3e9b0a5d-kube-api-access-gtc5t\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.816216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.816131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/580effc2-e723-4144-b7ac-e15a3e9b0a5d-cert\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.818450 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.818409 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert" (OuterVolumeSpecName: "cert") pod "4223fb29-e229-4a22-bac1-d523db36797a" (UID: "4223fb29-e229-4a22-bac1-d523db36797a"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:35:52.818450 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.818432 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn" (OuterVolumeSpecName: "kube-api-access-2stgn") pod "4223fb29-e229-4a22-bac1-d523db36797a" (UID: "4223fb29-e229-4a22-bac1-d523db36797a"). InnerVolumeSpecName "kube-api-access-2stgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:35:52.818836 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.818814 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/580effc2-e723-4144-b7ac-e15a3e9b0a5d-cert\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.825455 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.825430 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtc5t\" (UniqueName: \"kubernetes.io/projected/580effc2-e723-4144-b7ac-e15a3e9b0a5d-kube-api-access-gtc5t\") pod \"kserve-controller-manager-799c68cd74-rhbj8\" (UID: \"580effc2-e723-4144-b7ac-e15a3e9b0a5d\") " pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:52.917620 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.917532 2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4223fb29-e229-4a22-bac1-d523db36797a-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:35:52.917620 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.917573 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2stgn\" (UniqueName: \"kubernetes.io/projected/4223fb29-e229-4a22-bac1-d523db36797a-kube-api-access-2stgn\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:35:52.982485 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:52.982442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:53.070525 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.070492 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" event={"ID":"4223fb29-e229-4a22-bac1-d523db36797a","Type":"ContainerDied","Data":"92ec4b69d84058fa241da4d163523122f7f246db1bb66abc69dd3064d3d22efc"} Jul 09 15:35:53.070691 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.070571 2557 scope.go:117] "RemoveContainer" containerID="e33da7db60914936dcb91d7f0bc1cf3a8e1b89cf10b8f5208da92c945b6a5b87" Jul 09 15:35:53.070691 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.070506 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-dqccd" Jul 09 15:35:53.096600 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.096569 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:53.100170 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.100134 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-dqccd"] Jul 09 15:35:53.132775 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:53.132751 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-rhbj8"] Jul 09 15:35:53.135104 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:35:53.135076 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580effc2_e723_4144_b7ac_e15a3e9b0a5d.slice/crio-7cb9c7b7358489b56d994ad13b5dd72e3992fd07bb400a56d995aba04c7c712e WatchSource:0}: Error finding container 7cb9c7b7358489b56d994ad13b5dd72e3992fd07bb400a56d995aba04c7c712e: Status 404 returned error can't find the container with id 7cb9c7b7358489b56d994ad13b5dd72e3992fd07bb400a56d995aba04c7c712e Jul 09 15:35:54.077135 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:54.077095 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="ffa60ad5e5a0ebdab2437d9a35613aebfdb6baac5946c7c830826e628071ad1a" exitCode=1 Jul 09 15:35:54.077583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:54.077187 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"ffa60ad5e5a0ebdab2437d9a35613aebfdb6baac5946c7c830826e628071ad1a"} Jul 09 15:35:54.077583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:54.077253 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerStarted","Data":"7cb9c7b7358489b56d994ad13b5dd72e3992fd07bb400a56d995aba04c7c712e"} Jul 09 15:35:54.077583 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:54.077456 2557 scope.go:117] "RemoveContainer" containerID="ffa60ad5e5a0ebdab2437d9a35613aebfdb6baac5946c7c830826e628071ad1a" Jul 09 15:35:54.794513 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:54.794482 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4223fb29-e229-4a22-bac1-d523db36797a" path="/var/lib/kubelet/pods/4223fb29-e229-4a22-bac1-d523db36797a/volumes" Jul 09 15:35:56.088851 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:56.088819 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" exitCode=1 Jul 09 15:35:56.089314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:56.088905 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab"} Jul 09 15:35:56.089314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:56.088963 2557 scope.go:117] "RemoveContainer" containerID="ffa60ad5e5a0ebdab2437d9a35613aebfdb6baac5946c7c830826e628071ad1a" Jul 09 15:35:56.089314 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:56.089112 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:35:56.089481 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:56.089334 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:35:57.094132 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:57.094103 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:35:57.094520 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:57.094322 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:35:57.982999 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:57.982961 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:35:58.099053 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:35:58.099024 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:35:58.099453 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:35:58.099196 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:02.983407 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:02.983350 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:36:02.983810 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:02.983774 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:36:02.983964 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:02.983943 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:11.862695 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.862658 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-765898c879-hl84l"] Jul 09 15:36:11.863071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863026 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.863071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863039 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.863071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863050 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.863071 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863057 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.863200 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863121 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.863200 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.863128 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:36:11.866251 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.866221 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.879879 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.879850 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765898c879-hl84l"] Jul 09 15:36:11.975600 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975600 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975602 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-console-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975634 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-service-ca\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975657 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-oauth-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-oauth-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-trusted-ca-bundle\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:11.975817 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:11.975737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2g99\" (UniqueName: \"kubernetes.io/projected/a1200950-8336-4f1f-a850-ec334c6df28f-kube-api-access-d2g99\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076317 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076422 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-console-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076422 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-service-ca\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076422 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-oauth-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076422 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-oauth-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076586 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-trusted-ca-bundle\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.076586 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.076478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2g99\" (UniqueName: \"kubernetes.io/projected/a1200950-8336-4f1f-a850-ec334c6df28f-kube-api-access-d2g99\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.077280 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.077187 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-console-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.077433 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.077294 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-oauth-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.077433 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.077353 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-service-ca\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.077693 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.077664 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1200950-8336-4f1f-a850-ec334c6df28f-trusted-ca-bundle\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.079041 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.079016 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-oauth-config\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.079174 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.079156 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1200950-8336-4f1f-a850-ec334c6df28f-console-serving-cert\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.086327 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.086305 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2g99\" (UniqueName: \"kubernetes.io/projected/a1200950-8336-4f1f-a850-ec334c6df28f-kube-api-access-d2g99\") pod \"console-765898c879-hl84l\" (UID: \"a1200950-8336-4f1f-a850-ec334c6df28f\") " pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.175641 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.175551 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:12.321009 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:12.320971 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765898c879-hl84l"] Jul 09 15:36:13.163206 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:13.163164 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765898c879-hl84l" event={"ID":"a1200950-8336-4f1f-a850-ec334c6df28f","Type":"ContainerStarted","Data":"0b2b1bb7451ce5a02d67765254bab94f42d2d311d394ac8f773850d75329939e"} Jul 09 15:36:13.163679 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:13.163216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765898c879-hl84l" event={"ID":"a1200950-8336-4f1f-a850-ec334c6df28f","Type":"ContainerStarted","Data":"e58644778fd1bdce4561a4eb2ec7c9b39e58eb206b88b5db5f1ee788a3770e39"} Jul 09 15:36:13.184041 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:13.183984 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-765898c879-hl84l" podStartSLOduration=2.183968609 podStartE2EDuration="2.183968609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:36:13.182577354 +0000 UTC m=+596.961318180" watchObservedRunningTime="2026-07-09 15:36:13.183968609 +0000 UTC m=+596.962709420" Jul 09 15:36:16.792273 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:16.792219 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:36:18.188757 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:18.188718 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" exitCode=1 Jul 09 15:36:18.189299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:18.188799 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e"} Jul 09 15:36:18.189299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:18.188865 2557 scope.go:117] "RemoveContainer" containerID="8e3ed00100bb3981a0d09420eaa9c65e76ee13d329b4a0a16520e5981d4dddab" Jul 09 15:36:18.189299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:18.189197 2557 scope.go:117] "RemoveContainer" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" Jul 09 15:36:18.189503 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:18.189479 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:22.176592 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.176550 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:22.177022 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.176639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:22.181440 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.181414 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:22.211950 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.211919 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-765898c879-hl84l" Jul 09 15:36:22.269947 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.269908 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:36:22.983345 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.983311 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:36:22.983520 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.983374 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:36:22.983679 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:22.983666 2557 scope.go:117] "RemoveContainer" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" Jul 09 15:36:22.983868 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:22.983845 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:35.789497 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:35.789463 2557 scope.go:117] "RemoveContainer" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" Jul 09 15:36:35.789957 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:35.789636 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:47.292075 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.291982 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-888bb54cc-cbkn9" podUID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" containerName="console" containerID="cri-o://15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740" gracePeriod=15 Jul 09 15:36:47.541444 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.541412 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:36:47.579895 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.579793 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.579895 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.579860 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580128 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.579966 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580128 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580008 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580128 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580064 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7h4l\" (UniqueName: \"kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580128 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580125 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580359 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580158 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config\") pod \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\" (UID: \"be2fde15-3459-4ab7-9fd0-ab326d43a39c\") " Jul 09 15:36:47.580359 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580297 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config" (OuterVolumeSpecName: "console-config") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:36:47.580359 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580314 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:36:47.580569 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580547 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.580644 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580561 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca" (OuterVolumeSpecName: "service-ca") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:36:47.580644 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580575 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.580833 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.580751 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:36:47.582376 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.582350 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:36:47.582484 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.582398 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:36:47.582552 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.582502 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l" (OuterVolumeSpecName: "kube-api-access-l7h4l") pod "be2fde15-3459-4ab7-9fd0-ab326d43a39c" (UID: "be2fde15-3459-4ab7-9fd0-ab326d43a39c"). InnerVolumeSpecName "kube-api-access-l7h4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:36:47.681836 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.681801 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.681836 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.681831 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.681836 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.681842 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be2fde15-3459-4ab7-9fd0-ab326d43a39c-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.682082 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.681851 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7h4l\" (UniqueName: \"kubernetes.io/projected/be2fde15-3459-4ab7-9fd0-ab326d43a39c-kube-api-access-l7h4l\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:47.682082 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:47.681861 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be2fde15-3459-4ab7-9fd0-ab326d43a39c-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\"" Jul 09 15:36:48.323975 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.323940 2557 generic.go:356] "Generic (PLEG): container finished" podID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" containerID="15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740" exitCode=0 Jul 09 15:36:48.324410 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.323983 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-888bb54cc-cbkn9" Jul 09 15:36:48.324410 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.324026 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-888bb54cc-cbkn9" event={"ID":"be2fde15-3459-4ab7-9fd0-ab326d43a39c","Type":"ContainerDied","Data":"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740"} Jul 09 15:36:48.324410 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.324079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-888bb54cc-cbkn9" event={"ID":"be2fde15-3459-4ab7-9fd0-ab326d43a39c","Type":"ContainerDied","Data":"0bc0a6fe8bf3ac812febdc9904ef4bf001f58f3cb3cf2efc05fd4d73cfb0f6f5"} Jul 09 15:36:48.324410 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.324103 2557 scope.go:117] "RemoveContainer" containerID="15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740" Jul 09 15:36:48.333363 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.333346 2557 scope.go:117] "RemoveContainer" containerID="15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740" Jul 09 15:36:48.333631 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:48.333612 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740\": container with ID starting with 15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740 not found: ID does not exist" containerID="15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740" Jul 09 15:36:48.333700 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.333640 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740"} err="failed to get container status \"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740\": rpc error: code = NotFound desc = could not find container \"15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740\": container with ID starting with 15d1c569e0e3d17ec6fc35edf7d3642f0d19c63617c9d1011795a8321700a740 not found: ID does not exist" Jul 09 15:36:48.349687 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.349660 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:36:48.356143 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.356118 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-888bb54cc-cbkn9"] Jul 09 15:36:48.794958 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:48.794929 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" path="/var/lib/kubelet/pods/be2fde15-3459-4ab7-9fd0-ab326d43a39c/volumes" Jul 09 15:36:49.789592 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:49.789557 2557 scope.go:117] "RemoveContainer" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" Jul 09 15:36:51.338879 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:51.338840 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" exitCode=1 Jul 09 15:36:51.339317 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:51.338908 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e"} Jul 09 15:36:51.339317 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:51.338965 2557 scope.go:117] "RemoveContainer" containerID="1b53e81164cde3df9471fa56d3dccbdaf4580d2b4dacd3b5ec8af6bd1dc25c0e" Jul 09 15:36:51.339417 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:51.339349 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:36:51.339580 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:51.339555 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:36:52.982977 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:52.982928 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:36:52.983470 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:52.982997 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:36:52.983470 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:36:52.983361 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:36:52.983606 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:36:52.983584 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:07.789580 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:07.789549 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:37:07.790024 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:07.789748 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:19.789826 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:19.789792 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:37:19.790277 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:19.789977 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:31.789562 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:31.789529 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:37:32.517391 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.517294 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" exitCode=1 Jul 09 15:37:32.517391 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.517368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9"} Jul 09 15:37:32.517622 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.517427 2557 scope.go:117] "RemoveContainer" containerID="a8ecb9fbebe4ecd0cf63a809b8cab78bd4bc8633e7542972e84eb038cb32ec7e" Jul 09 15:37:32.517771 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.517743 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:37:32.517958 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:32.517938 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:32.983191 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.983155 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:37:32.983596 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:32.983221 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:37:33.530736 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:33.530702 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:37:33.530912 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:33.530879 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:46.791611 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:46.791570 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:37:46.792197 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:46.791749 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:37:58.794560 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:37:58.794521 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:37:58.795025 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:37:58.794718 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:38:12.794723 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:12.794694 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:38:12.795178 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:38:12.794879 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:38:23.789470 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:23.789435 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:38:23.789854 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:38:23.789626 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:38:34.789752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:34.789713 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:38:34.790291 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:38:34.789916 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:38:46.791727 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:46.791697 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:38:46.792451 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:38:46.791886 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:38:59.789728 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:59.789689 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:38:59.790111 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:38:59.789987 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:39:00.902539 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:00.902497 2557 generic.go:356] "Generic (PLEG): container finished" podID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" exitCode=1 Jul 09 15:39:00.902940 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:00.902571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" event={"ID":"580effc2-e723-4144-b7ac-e15a3e9b0a5d","Type":"ContainerDied","Data":"fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9"} Jul 09 15:39:00.902940 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:00.902631 2557 scope.go:117] "RemoveContainer" containerID="7b5604f0d6f31b316003b47562bd3472b33d698e795d747b8a59a8a8e27ea4c9" Jul 09 15:39:00.903028 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:00.902976 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:00.903154 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:00.903135 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:39:02.983105 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:02.983054 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:39:02.983632 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:02.983139 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" Jul 09 15:39:02.983632 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:02.983564 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:02.983818 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:02.983793 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:39:16.791418 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:16.791391 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:16.791826 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:16.791561 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:39:29.790043 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:29.790010 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:29.790544 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:29.790174 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:39:41.789688 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:41.789600 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:41.790128 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:41.789787 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:39:53.789507 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:39:53.789474 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:39:53.789986 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:39:53.789668 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:40:04.789537 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:40:04.789496 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:40:04.790125 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:40:04.789696 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:40:15.788984 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:40:15.788952 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:40:15.789434 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:40:15.789147 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:40:29.789299 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:40:29.789267 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:40:29.789703 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:40:29.789445 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:40:42.790036 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:40:42.789997 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:40:42.790455 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:40:42.790271 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:40:54.789392 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:40:54.789354 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:40:54.789847 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:40:54.789595 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:41:09.789963 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:09.789929 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:41:09.790394 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:41:09.790145 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:41:20.745952 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:20.745912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-25mk8_932a0aa0-dc25-4e87-b76a-0b0f68f5b0a4/global-pull-secret-syncer/0.log" Jul 09 15:41:20.925049 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:20.924959 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pgmkv_f509e9c8-f91f-45eb-a1ef-4b4dce199bd4/konnectivity-agent/0.log" Jul 09 15:41:20.994690 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:20.994653 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-233.ec2.internal_dfaa49bed4f018674f19ee2e2bb3d341/haproxy/0.log" Jul 09 15:41:22.790028 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:22.789994 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:41:22.790564 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:41:22.790142 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:41:25.177767 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.177738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/alertmanager/0.log" Jul 09 15:41:25.205045 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.205015 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/config-reloader/0.log" Jul 09 15:41:25.231556 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.231525 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/kube-rbac-proxy-web/0.log" Jul 09 15:41:25.255959 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.255923 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/kube-rbac-proxy/0.log" Jul 09 15:41:25.285854 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.285829 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/kube-rbac-proxy-metric/0.log" Jul 09 15:41:25.323081 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.323055 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/prom-label-proxy/0.log" Jul 09 15:41:25.355020 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.354990 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ad59c33-bff1-4ad6-8af4-3ca0c24e12ae/init-config-reloader/0.log" Jul 09 15:41:25.442618 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.442530 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-442rw_5f485a03-12c4-4d29-b848-d0828baaacc6/kube-state-metrics/0.log" Jul 09 15:41:25.500604 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.500565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-442rw_5f485a03-12c4-4d29-b848-d0828baaacc6/kube-rbac-proxy-main/0.log" Jul 09 15:41:25.543313 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.543285 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-442rw_5f485a03-12c4-4d29-b848-d0828baaacc6/kube-rbac-proxy-self/0.log" Jul 09 15:41:25.646185 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.646150 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nzhc_b849a374-3f7b-4ce2-86a1-d9e261093c60/node-exporter/0.log" Jul 09 15:41:25.668056 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.668028 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nzhc_b849a374-3f7b-4ce2-86a1-d9e261093c60/kube-rbac-proxy/0.log" Jul 09 15:41:25.697054 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.696977 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nzhc_b849a374-3f7b-4ce2-86a1-d9e261093c60/init-textfile/0.log" Jul 09 15:41:25.948229 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.948147 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f8n9s_42fe24ee-094b-40da-b7a4-b1f8fd1ec15c/kube-rbac-proxy-main/0.log" Jul 09 15:41:25.973752 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.973727 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f8n9s_42fe24ee-094b-40da-b7a4-b1f8fd1ec15c/kube-rbac-proxy-self/0.log" Jul 09 15:41:25.997806 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:25.997777 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-f8n9s_42fe24ee-094b-40da-b7a4-b1f8fd1ec15c/openshift-state-metrics/0.log" Jul 09 15:41:28.730733 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:28.730701 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-765898c879-hl84l_a1200950-8336-4f1f-a850-ec334c6df28f/console/0.log" Jul 09 15:41:29.260697 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:29.260664 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-thxhj_f60018e2-8872-49c0-8bc6-61b97aa7449b/volume-data-source-validator/0.log" Jul 09 15:41:30.154940 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:30.154914 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6kgcn_9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5/dns/0.log" Jul 09 15:41:30.180607 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:30.180569 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6kgcn_9c0038cf-7f1f-4ecc-96d0-2a09acba9cd5/kube-rbac-proxy/0.log" Jul 09 15:41:30.340051 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:30.340022 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nflcx_2ec6370b-061a-49f0-8fec-6c4d21693e47/dns-node-resolver/0.log" Jul 09 15:41:30.862331 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:30.862293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2zl9_2765aa5c-e7e9-4443-a96b-579037e9ebed/node-ca/0.log" Jul 09 15:41:31.010887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.010852 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r"] Jul 09 15:41:31.011181 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011170 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" containerName="console" Jul 09 15:41:31.011227 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011183 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" containerName="console" Jul 09 15:41:31.011227 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011207 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:41:31.011227 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011212 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:41:31.011351 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011283 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2fde15-3459-4ab7-9fd0-ab326d43a39c" containerName="console" Jul 09 15:41:31.011351 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.011293 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4223fb29-e229-4a22-bac1-d523db36797a" containerName="manager" Jul 09 15:41:31.014432 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.014408 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.018095 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.018074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2hw6\"/\"default-dockercfg-fhvvw\"" Jul 09 15:41:31.018410 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.018394 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2hw6\"/\"openshift-service-ca.crt\"" Jul 09 15:41:31.019216 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.019200 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2hw6\"/\"kube-root-ca.crt\"" Jul 09 15:41:31.027308 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.027286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r"] Jul 09 15:41:31.184856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.184757 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-lib-modules\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.184856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.184800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-sys\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.184856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.184818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-podres\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.184856 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.184834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slv6b\" (UniqueName: \"kubernetes.io/projected/d4e76195-fe07-467f-9df1-d45f21e6483e-kube-api-access-slv6b\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.185394 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.184925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-proc\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286023 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.285964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-lib-modules\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286023 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-sys\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286060 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-podres\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slv6b\" (UniqueName: \"kubernetes.io/projected/d4e76195-fe07-467f-9df1-d45f21e6483e-kube-api-access-slv6b\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-proc\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286129 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-sys\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286164 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-lib-modules\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286211 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-proc\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.286341 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.286217 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4e76195-fe07-467f-9df1-d45f21e6483e-podres\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.295323 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.295303 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slv6b\" (UniqueName: \"kubernetes.io/projected/d4e76195-fe07-467f-9df1-d45f21e6483e-kube-api-access-slv6b\") pod \"perf-node-gather-daemonset-4fq5r\" (UID: \"d4e76195-fe07-467f-9df1-d45f21e6483e\") " pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.324398 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.324369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:31.455375 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.455297 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r"] Jul 09 15:41:31.457596 ip-10-0-137-233 kubenswrapper[2557]: W0709 15:41:31.457567 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4e76195_fe07_467f_9df1_d45f21e6483e.slice/crio-20e85ccf5890e751fe5d8ee115c8fedcdf1ea5c967d9785b50381e7d1c11d22e WatchSource:0}: Error finding container 20e85ccf5890e751fe5d8ee115c8fedcdf1ea5c967d9785b50381e7d1c11d22e: Status 404 returned error can't find the container with id 20e85ccf5890e751fe5d8ee115c8fedcdf1ea5c967d9785b50381e7d1c11d22e Jul 09 15:41:31.548487 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.548456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" event={"ID":"d4e76195-fe07-467f-9df1-d45f21e6483e","Type":"ContainerStarted","Data":"20e85ccf5890e751fe5d8ee115c8fedcdf1ea5c967d9785b50381e7d1c11d22e"} Jul 09 15:41:31.818965 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:31.818924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55df9d5cb-wsm87_f529bde7-e470-4790-b8ab-e7bd2466c895/router/0.log" Jul 09 15:41:32.197178 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.197093 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9dcfs_340d850e-c7ed-4014-87ab-c132b2bf7900/serve-healthcheck-canary/0.log" Jul 09 15:41:32.553838 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.553800 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" event={"ID":"d4e76195-fe07-467f-9df1-d45f21e6483e","Type":"ContainerStarted","Data":"352a4e7800d6d9a24d80dc971a8cf6238150b62ee7fbb5f7c145bd71343f5585"} Jul 09 15:41:32.554040 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.553928 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:32.572380 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.572328 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" podStartSLOduration=2.572313432 podStartE2EDuration="2.572313432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:41:32.571105956 +0000 UTC m=+916.349846766" watchObservedRunningTime="2026-07-09 15:41:32.572313432 +0000 UTC m=+916.351054242" Jul 09 15:41:32.795488 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.795457 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvdf6_bd8a7832-0acb-40f0-bac7-299f42a81ad3/kube-rbac-proxy/0.log" Jul 09 15:41:32.817671 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.817595 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvdf6_bd8a7832-0acb-40f0-bac7-299f42a81ad3/exporter/0.log" Jul 09 15:41:32.840342 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:32.840316 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvdf6_bd8a7832-0acb-40f0-bac7-299f42a81ad3/extractor/0.log" Jul 09 15:41:34.872830 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:34.872794 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-rhbj8_580effc2-e723-4144-b7ac-e15a3e9b0a5d/manager/5.log" Jul 09 15:41:34.872830 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:34.872809 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-rhbj8_580effc2-e723-4144-b7ac-e15a3e9b0a5d/manager/5.log" Jul 09 15:41:34.894090 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:34.894057 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-h4k6k_c21e0eb4-55d1-410d-8bf9-4899362ed028/manager/0.log" Jul 09 15:41:35.789077 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:35.789046 2557 scope.go:117] "RemoveContainer" containerID="fa6cb9ed41d1882ad1c004784a107a3f9ad79a641d0fec54608effb90dc84bd9" Jul 09 15:41:35.789301 ip-10-0-137-233 kubenswrapper[2557]: E0709 15:41:35.789220 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-rhbj8_kserve(580effc2-e723-4144-b7ac-e15a3e9b0a5d)\"" pod="kserve/kserve-controller-manager-799c68cd74-rhbj8" podUID="580effc2-e723-4144-b7ac-e15a3e9b0a5d" Jul 09 15:41:38.507884 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:38.507845 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-77cmn_42b6e3ee-a443-4275-bb0f-44422429975c/migrator/0.log" Jul 09 15:41:38.528915 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:38.528880 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-77cmn_42b6e3ee-a443-4275-bb0f-44422429975c/graceful-termination/0.log" Jul 09 15:41:38.569271 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:38.569218 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2hw6/perf-node-gather-daemonset-4fq5r" Jul 09 15:41:39.967743 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:39.967717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/kube-multus-additional-cni-plugins/0.log" Jul 09 15:41:39.991381 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:39.991351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/egress-router-binary-copy/0.log" Jul 09 15:41:40.018265 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.018219 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/cni-plugins/0.log" Jul 09 15:41:40.041855 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.041828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/bond-cni-plugin/0.log" Jul 09 15:41:40.063887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.063853 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/routeoverride-cni/0.log" Jul 09 15:41:40.088436 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.088406 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/whereabouts-cni-bincopy/0.log" Jul 09 15:41:40.113169 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.113139 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5w46_c07131eb-5ea7-4cb7-a584-5c9e6e09e9bd/whereabouts-cni/0.log" Jul 09 15:41:40.574887 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.574853 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nlj5c_701d0a50-9308-46ca-bc80-b7eb0a997912/kube-multus/0.log" Jul 09 15:41:40.633931 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.633902 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8sb66_a5478fed-b36a-46ec-8007-a17271377208/network-metrics-daemon/0.log" Jul 09 15:41:40.661364 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:40.661280 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8sb66_a5478fed-b36a-46ec-8007-a17271377208/kube-rbac-proxy/0.log" Jul 09 15:41:41.982563 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:41.982471 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/ovn-controller/0.log" Jul 09 15:41:42.005356 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.005317 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/ovn-acl-logging/0.log" Jul 09 15:41:42.043580 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.043541 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/kube-rbac-proxy-node/0.log" Jul 09 15:41:42.068851 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.068817 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 15:41:42.086345 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.086320 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/northd/0.log" Jul 09 15:41:42.107084 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.107038 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/nbdb/0.log" Jul 09 15:41:42.128964 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.128935 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/sbdb/0.log" Jul 09 15:41:42.189588 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:42.189557 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9v9p_c36c65a4-41d8-4c61-8c45-8c0d797c3b1f/ovnkube-controller/0.log" Jul 09 15:41:43.241078 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:43.241044 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fpfd6_9f64724a-3d0f-4884-a141-b00744e85199/network-check-target-container/0.log" Jul 09 15:41:44.182946 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:44.182915 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-k6t4j_fc28b495-b19f-4b56-9d67-ee84ef383f9c/iptables-alerter/0.log" Jul 09 15:41:44.829363 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:44.829336 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9l8p6_c5dd9da2-c59b-4217-9c5c-21a1d54583bb/tuned/0.log" Jul 09 15:41:46.607911 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:46.607877 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-dpfcq_fdbde397-2757-4243-afc9-b5ee49807702/cluster-samples-operator/0.log" Jul 09 15:41:46.625865 ip-10-0-137-233 kubenswrapper[2557]: I0709 15:41:46.625840 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-dpfcq_fdbde397-2757-4243-afc9-b5ee49807702/cluster-samples-operator-watch/0.log"