Jul 07 14:09:45.399866 ip-10-0-130-166 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.726584 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732198 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732208 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732211 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732215 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732226 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732229 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732235 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:45.832165 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732238 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:45.794821 ip-10-0-130-166 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732241 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732244 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732247 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732250 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732253 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732255 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732258 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732261 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732263 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732268 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732272 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732275 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732278 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732281 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732284 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732286 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732289 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732293 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:45.834657 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732295 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732298 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732300 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732303 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732306 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732308 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732311 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732313 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732316 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732319 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732321 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732330 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732335 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732338 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732340 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732343 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732345 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732348 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732350 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732353 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:45.837860 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732356 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732358 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732361 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732363 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732367 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732369 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732372 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732374 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732376 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732379 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732382 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732384 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732387 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732389 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732392 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732395 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732398 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732400 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732403 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732405 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:45.841335 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732408 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732410 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732413 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732416 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732418 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732421 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732424 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732426 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732430 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732435 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732438 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732441 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732444 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732446 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732449 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732452 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732454 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732457 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732459 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:45.842429 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732462 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732464 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732467 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732470 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732472 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732475 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732477 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732480 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732482 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732485 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732488 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732490 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732493 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.732495 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733823 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733830 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733833 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733836 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733841 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733844 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:45.843352 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733847 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733850 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733853 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733857 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733860 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733863 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733865 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733868 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733871 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733874 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733876 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733879 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733881 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733884 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733887 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733889 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733892 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733894 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733897 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733899 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:45.844157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733902 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733904 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733906 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733909 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733912 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733915 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733917 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733920 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733923 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733925 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733928 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733930 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733933 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733936 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733938 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733941 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733944 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733946 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733949 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733951 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:45.844964 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733954 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733959 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733963 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733966 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733968 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733971 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733974 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733976 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733979 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733983 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733986 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733989 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733992 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733994 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.733997 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734000 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734003 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734006 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734008 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:45.845766 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734010 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734015 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734018 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734022 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734026 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734029 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734064 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734111 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734116 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734121 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734148 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734155 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734159 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734163 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734178 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734184 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734188 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734193 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734283 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:45.846363 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734289 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734300 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734304 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734309 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734314 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734317 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734322 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734327 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734333 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734337 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734341 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734346 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734351 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734355 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.734365 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735741 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735750 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735754 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735757 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:45.846977 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735760 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735763 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735766 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735768 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735771 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735774 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735776 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735779 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735781 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735784 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735786 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735789 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735791 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735794 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735797 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735799 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735802 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735804 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735807 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735810 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:45.847536 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735814 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735819 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735824 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735827 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735829 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735833 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735836 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735839 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735841 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735844 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735846 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735849 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735851 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735854 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735857 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735859 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735862 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735864 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735867 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:45.848239 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735869 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735872 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735874 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735876 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735879 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735881 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735884 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735888 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735891 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735894 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735897 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735899 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735902 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735907 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735911 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735914 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735917 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735920 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735923 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735926 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:45.848784 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735929 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735931 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735934 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735936 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735939 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735941 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735944 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735946 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735949 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735951 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735954 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735956 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735959 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735961 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735963 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735966 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735968 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735971 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735973 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735976 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:45.849336 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735978 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735981 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735983 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735986 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735989 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735993 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735996 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.735999 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736001 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736004 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736006 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736009 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736011 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736014 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736016 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736019 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736085 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736091 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736097 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736101 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736105 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:09:45.850055 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736108 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736112 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736116 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736119 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736122 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736125 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736128 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736131 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736134 2560 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736137 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736139 2560 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736142 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736145 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736149 2560 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736151 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736154 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736160 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736164 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736168 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736171 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736174 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736177 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736179 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736182 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:09:45.850729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736185 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736188 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736191 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736195 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736198 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736201 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736204 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736207 2560 flags.go:64] FLAG: --enable-server="true" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736210 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736215 2560 flags.go:64] FLAG: --event-burst="100" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736218 2560 flags.go:64] FLAG: --event-qps="50" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736221 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736223 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736226 2560 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736229 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736232 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736235 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736238 2560 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736241 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736244 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736247 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736250 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736253 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736255 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736260 2560 flags.go:64] FLAG: --feature-gates="" Jul 07 14:09:45.851329 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736265 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736268 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736271 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736274 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736277 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736280 2560 flags.go:64] FLAG: --help="false" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736283 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-166.ec2.internal" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736286 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736289 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736292 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736295 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736298 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736301 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736303 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736306 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736309 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736312 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736315 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736318 2560 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736320 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736323 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736326 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736329 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736331 2560 flags.go:64] FLAG: --lock-file="" Jul 07 14:09:45.852085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736334 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736337 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736339 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736344 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736347 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736350 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736353 2560 flags.go:64] FLAG: --logging-format="text" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736356 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736362 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736366 2560 flags.go:64] FLAG: --manifest-url="" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736369 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736373 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736376 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736380 2560 flags.go:64] FLAG: --max-pods="110" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736383 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736385 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736388 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736391 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736394 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736396 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736399 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736405 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736407 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736410 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:09:45.853335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736413 2560 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736416 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736422 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736424 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736427 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736430 2560 flags.go:64] FLAG: --port="10250" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736433 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736435 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08968043430cafe7c" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736438 2560 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736441 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736444 2560 flags.go:64] FLAG: --register-node="true" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736447 2560 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736450 2560 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736453 2560 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736456 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736459 2560 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736463 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736467 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736470 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736473 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736476 2560 flags.go:64] FLAG: --runonce="false" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736478 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736481 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736484 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736487 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:09:45.854039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736490 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736492 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736495 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736498 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736501 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736503 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736506 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736509 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736512 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736514 2560 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736517 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736522 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736525 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736528 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736531 2560 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736534 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736536 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736539 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736542 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736545 2560 flags.go:64] FLAG: --v="2" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736548 2560 flags.go:64] FLAG: --version="false" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736552 2560 flags.go:64] FLAG: --vmodule="" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736557 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.736560 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:09:46.022492 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736677 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736690 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736694 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736698 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736702 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736705 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736708 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736711 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736714 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736717 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736720 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736723 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736725 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736727 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736730 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736733 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736735 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736737 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736740 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736742 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:46.046128 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736745 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736747 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736751 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736754 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736757 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736760 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736762 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736764 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736767 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736770 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736774 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736777 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736781 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736784 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736787 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736790 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736792 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736795 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736797 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:46.046914 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736800 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736802 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736805 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736807 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736810 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736812 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736815 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736817 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736820 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736822 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736825 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736827 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736830 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736833 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736835 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736838 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736840 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736843 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736845 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736848 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:46.047731 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736850 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736853 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736855 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736859 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736861 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736865 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736867 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736870 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736872 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736875 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736878 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736880 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736883 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736885 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736888 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736890 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736893 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736895 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736898 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736900 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:46.048551 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736903 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736905 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736908 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736910 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736913 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736916 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736918 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736921 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736923 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736926 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736928 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736931 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736933 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736936 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736939 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736942 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736945 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736948 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736951 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:46.049350 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.736953 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.737469 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.743702 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.743715 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.743733 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.743739 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743792 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743796 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743800 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743803 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743806 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743809 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743812 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743815 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743818 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:46.050157 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743821 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743825 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743829 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743832 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743835 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743838 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743841 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743844 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743847 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743849 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743852 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743854 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743857 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743859 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743862 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743865 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743867 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743870 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743873 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:46.050994 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743876 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743879 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743882 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743884 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743887 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743890 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743892 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743895 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743897 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743900 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743902 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743905 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743907 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743910 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743912 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743915 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743917 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743919 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743922 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743924 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743927 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:46.051805 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743929 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743932 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743934 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743937 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743939 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743943 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743946 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743952 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743955 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743959 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743962 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743965 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743968 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743971 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743974 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743976 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743979 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743982 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743984 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:46.052611 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743988 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743992 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743994 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743997 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.743999 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744002 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744004 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744007 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744010 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744012 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744015 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744017 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744020 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744022 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744024 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744027 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744029 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744032 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744034 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744037 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:46.053414 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744041 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744044 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744048 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744052 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744054 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744056 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744059 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744062 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744065 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744067 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744070 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.744074 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744185 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744190 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744193 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:46.054224 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744196 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744198 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744201 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744204 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744207 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744210 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744213 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744216 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744218 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744221 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744224 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744226 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744229 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744231 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744234 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744236 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744239 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744242 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744247 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:46.055017 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744250 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744254 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744256 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744259 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744262 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744265 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744270 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744272 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744275 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744279 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744281 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744284 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744287 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744289 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744292 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744294 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744297 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744299 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744302 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:46.055832 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744304 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744307 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744310 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744312 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744315 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744317 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744320 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744323 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744325 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744328 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744330 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744334 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744338 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744343 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744345 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744348 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744350 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744353 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744355 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744358 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:46.057044 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744361 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744363 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744366 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744370 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744373 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744376 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744379 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744381 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744384 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744387 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744389 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744392 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744395 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744397 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744400 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744402 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744405 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744407 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744410 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:46.057862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744413 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744415 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744418 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744420 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744422 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744426 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744430 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744432 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744435 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744437 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744440 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744443 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744445 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744448 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744451 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744454 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744456 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744458 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:46.058679 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:45.744461 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.744466 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.744551 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.746476 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.747636 2560 server.go:1019] "Starting client certificate rotation" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.747753 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.747790 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.749773 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.751405 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.762608 2560 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.764959 2560 log.go:25] "Validated CRI v1 image API" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.766680 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:09:46.059497 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.769441 2560 fs.go:135] Filesystem UUIDs: map[21a5ce9d-3042-43d0-b529-0c9bf5c80209:/dev/nvme0n1p4 4a4af3d8-012b-40a1-b2f0-e4ade7137c21:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 14:09:46.059890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.769458 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.775557 2560 manager.go:216] Machine: {Timestamp:2026-07-07 14:09:45.774241455 +0000 UTC m=+0.271851347 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101145 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec207b413030f6994f544b0196786809 SystemUUID:ec207b41-3030-f699-4f54-4b0196786809 BootID:d35b8f85-f67b-4cec-bcdc-ab63fc501994 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:59:77:e8:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:59:77:e8:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:85:c2:d5:50:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.775698 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.775789 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.776702 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.778395 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.778421 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:09:46.060281 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.779079 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.779092 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.779102 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.779667 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.780889 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.784838 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.784984 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785016 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785029 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785047 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785060 2560 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785072 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785433 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.785453 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.787347 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.789179 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.789206 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790263 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790276 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790282 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790287 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790305 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790313 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790322 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790328 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790334 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790339 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790353 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790359 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790971 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.790981 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.793925 2560 server.go:1268] "Started kubelet" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.793982 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.794563 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.794648 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.796018 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.796429 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.797785 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.797797 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:09:46.065971 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.797827 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.800924 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.803619 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.803640 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.803717 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.803773 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tbcn5" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804290 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804290 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804310 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804375 2560 factory.go:55] Registering systemd factory Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804390 2560 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804415 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804422 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804636 2560 factory.go:153] Registering CRI-O factory Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804649 2560 factory.go:223] Registration of the crio container factory successfully Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804713 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804734 2560 factory.go:103] Registering Raw factory Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.804750 2560 manager.go:1196] Started watching for new ooms in manager Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.805488 2560 manager.go:349] Starting recovery of all containers Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.809445 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.809807 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.809611 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-166.ec2.internal.18c0073720d14906 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-166.ec2.internal,UID:ip-10-0-130-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-166.ec2.internal,},FirstTimestamp:2026-07-07 14:09:45.793898758 +0000 UTC m=+0.291508650,LastTimestamp:2026-07-07 14:09:45.793898758 +0000 UTC m=+0.291508650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-166.ec2.internal,}" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.813248 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tbcn5" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.817867 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.821421 2560 manager.go:354] Recovery completed Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.826928 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.828732 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.828760 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.828774 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.829262 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.829273 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.829290 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:46.067172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.829303 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.830010 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.830038 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.830055 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.831140 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-166.ec2.internal.18c0073722e5008e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-166.ec2.internal,UID:ip-10-0-130-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-166.ec2.internal,},FirstTimestamp:2026-07-07 14:09:45.828745358 +0000 UTC m=+0.326355257,LastTimestamp:2026-07-07 14:09:45.828745358 +0000 UTC m=+0.326355257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-166.ec2.internal,}" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.831744 2560 policy_none.go:49] "None policy: Start" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.831758 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.831770 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.834039 2560 policy_none.go:47] "Start" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870081 2560 manager.go:337] "Starting Device Plugin manager" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.870132 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870141 2560 server.go:87] "Starting device plugin registration server" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870353 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870364 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870503 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870623 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.870633 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.871003 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.871059 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.970742 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.971672 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.971703 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.971715 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.971737 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.982456 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.982472 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-166.ec2.internal\": node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.993758 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.993790 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.993807 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:45.993833 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:45.995813 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.007930 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.175447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.094164 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"] Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.094244 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.096543 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.096584 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.096600 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.098904 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099024 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099054 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099754 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099763 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099780 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099785 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099790 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.099794 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.102557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.102593 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.103305 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.103332 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.103346 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.105797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.105827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.105862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d321df27ccbda0a9064af37cdfbcd85b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"d321df27ccbda0a9064af37cdfbcd85b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.176666 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.108308 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d321df27ccbda0a9064af37cdfbcd85b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"d321df27ccbda0a9064af37cdfbcd85b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206444 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f5517289fd68c4c3c5fe705f6265efdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"f5517289fd68c4c3c5fe705f6265efdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.206494 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d321df27ccbda0a9064af37cdfbcd85b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"d321df27ccbda0a9064af37cdfbcd85b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.303556 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.208388 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.309244 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.308447 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.422762 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.408934 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.546003 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.509669 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.670159 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.610187 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.800390 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:46.710820 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found" Jul 07 14:09:46.800390 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.747004 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:09:46.800390 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.747181 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:46.802144 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.801241 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:46.805780 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.804395 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:46.805780 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.804414 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.818628 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.817130 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:04:46 +0000 UTC" deadline="2028-03-19 23:22:28.06934249 +0000 UTC" Jul 07 14:09:46.818628 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.817154 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14913h12m41.252190994s" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.820945 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.823828 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.825408 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.836129 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.845985 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vnx4" Jul 07 14:09:46.926182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.857359 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vnx4" Jul 07 14:09:47.058693 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.954811 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:47.058693 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:46.970387 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:47.785958 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.785937 2560 apiserver.go:52] "Watching apiserver" Jul 07 14:09:47.796947 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.796927 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:09:47.798827 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.798804 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9","openshift-dns/node-resolver-kt555","openshift-multus/network-metrics-daemon-d7svr","openshift-network-operator/iptables-alerter-pl9qz","openshift-ovn-kubernetes/ovnkube-node-5jd26","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pgwxd","openshift-image-registry/node-ca-lddn5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","openshift-multus/multus-6pt5b","openshift-multus/multus-additional-cni-plugins-9tw5l","openshift-network-diagnostics/network-check-target-42d9m","kube-system/global-pull-secret-syncer-zkpwv","kube-system/konnectivity-agent-dtr9s"] Jul 07 14:09:47.801511 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.801489 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.801596 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.801515 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.803839 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.803817 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.804502 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.804457 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:09:47.804502 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.804475 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-878h4\"" Jul 07 14:09:47.804720 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.804476 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.804720 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.804664 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.806108 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.806085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.806189 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.806165 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:47.806419 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.806394 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.806478 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.806454 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.806551 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.806534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mrvsb\"" Jul 07 14:09:47.808384 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.808365 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:47.810821 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.810801 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.810821 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.810801 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.811008 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.810904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.811095 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.811078 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-82hgx\"" Jul 07 14:09:47.811396 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.811380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:09:47.813258 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.813241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.813371 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.813327 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.813665 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.813644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.814425 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.814410 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.814771 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.814746 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:09:47.814868 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.814807 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bc72n\"" Jul 07 14:09:47.814931 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.814872 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:09:47.815336 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.815170 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:09:47.815336 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.815289 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.815786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9dl\" (UniqueName: \"kubernetes.io/projected/02ff2b42-e953-4f80-baf7-0848eabfa44e-kube-api-access-gb9dl\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.815823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-registration-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.815975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-device-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816134 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fpm\" (UniqueName: \"kubernetes.io/projected/0951b37b-f843-421a-aace-547733f217a1-kube-api-access-r6fpm\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-socket-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-sys-fs\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zp86\" (UniqueName: \"kubernetes.io/projected/4e3715f2-0c64-43da-87b7-c56ea578e974-kube-api-access-9zp86\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816599 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0951b37b-f843-421a-aace-547733f217a1-hosts-file\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.816680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.817315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0951b37b-f843-421a-aace-547733f217a1-tmp-dir\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.817315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.816743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.817315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.817000 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7nzhv\"" Jul 07 14:09:47.817315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.817164 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.817507 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.817413 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:47.817507 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.817467 2560 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.818908 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.818886 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xqxzk\"" Jul 07 14:09:47.819108 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.819086 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:09:47.819362 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.819348 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.819586 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.819546 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.819677 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.819665 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.821004 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.820987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.822074 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822059 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:09:47.822412 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.822482 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822413 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:09:47.822538 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822525 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:09:47.822588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822524 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:09:47.822588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.822576 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z44n9\"" Jul 07 14:09:47.824989 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.824970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:47.825095 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.825040 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:47.826644 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.825808 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:09:47.826644 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.825808 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pb54n\"" Jul 07 14:09:47.826644 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.825912 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:09:47.827764 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.827745 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:47.827850 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.827804 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:47.828361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.828346 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:47.828416 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.828383 2560 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.830230 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.830212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:47.830633 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.830615 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" Jul 07 14:09:47.830715 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.830696 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:47.832910 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.832887 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:09:47.832985 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.832955 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:09:47.833259 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.833242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kvpc9\"" Jul 07 14:09:47.860560 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.860535 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:46 +0000 UTC" deadline="2028-04-03 08:39:19.15622898 +0000 UTC" Jul 07 14:09:47.860560 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.860557 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15258h29m31.295674536s" Jul 07 14:09:47.905488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.905467 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-socket-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zp86\" (UniqueName: \"kubernetes.io/projected/4e3715f2-0c64-43da-87b7-c56ea578e974-kube-api-access-9zp86\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-tuned\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-tmp\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-agent-certs\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-var-lib-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-bin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-daemon-config\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0951b37b-f843-421a-aace-547733f217a1-hosts-file\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-kubernetes\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-conf\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05639699-cbac-42be-bd67-a297f0aba5e3-host\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-konnectivity-ca\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:47.918661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0951b37b-f843-421a-aace-547733f217a1-hosts-file\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.917987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-script-lib\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysconfig\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-socket-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-sys\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-systemd-units\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-registration-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-device-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-registration-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918705 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-lib-modules\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-ovn\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-device-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-config\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.919828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-cnibin\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.918997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-var-lib-kubelet\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-env-overrides\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-hostroot\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-modprobe-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-systemd\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwd8\" (UniqueName: \"kubernetes.io/projected/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-kube-api-access-nxwd8\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovn-node-metrics-cert\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-os-release\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-kubelet-config\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919592 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-systemd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-kubelet\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.919999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-bin\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnj9\" (UniqueName: \"kubernetes.io/projected/472b3a05-5073-4776-84a3-ab34a2a996f1-kube-api-access-kgnj9\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-iptables-alerter-script\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-etc-kubernetes\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-os-release\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-host\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-netd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.920719 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4w9\" (UniqueName: \"kubernetes.io/projected/114bfcd6-5390-423e-a0e1-21b42684dc0b-kube-api-access-7c4w9\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-cnibin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-cni-binary-copy\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krdnh\" (UniqueName: \"kubernetes.io/projected/a9401913-b94a-417e-b33d-61741c87fbe1-kube-api-access-krdnh\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920444 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-slash\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-socket-dir-parent\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-multus\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-run\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.920646 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05639699-cbac-42be-bd67-a297f0aba5e3-serviceca\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:47.921236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-689wb\" (UniqueName: \"kubernetes.io/projected/05639699-cbac-42be-bd67-a297f0aba5e3-kube-api-access-689wb\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-kubelet\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:47.920756 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:48.420739065 +0000 UTC m=+2.918348981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-system-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-system-cni-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fpm\" (UniqueName: \"kubernetes.io/projected/0951b37b-f843-421a-aace-547733f217a1-kube-api-access-r6fpm\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-sys-fs\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwjlv\" (UniqueName: \"kubernetes.io/projected/6b6d204c-8805-4f43-a42b-9cfb122f41a1-kube-api-access-fwjlv\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e3715f2-0c64-43da-87b7-c56ea578e974-sys-fs\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.920981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-multus-certs\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-k8s-cni-cncf-io\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.921701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-netns\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-host-slash\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-etc-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-log-socket\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921141 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-conf-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-dbus\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0951b37b-f843-421a-aace-547733f217a1-tmp-dir\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9dl\" (UniqueName: \"kubernetes.io/projected/02ff2b42-e953-4f80-baf7-0848eabfa44e-kube-api-access-gb9dl\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-netns\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-node-log\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:47.922185 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.921501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0951b37b-f843-421a-aace-547733f217a1-tmp-dir\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:47.925488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.925471 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:09:47.929200 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.929177 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zp86\" (UniqueName: \"kubernetes.io/projected/4e3715f2-0c64-43da-87b7-c56ea578e974-kube-api-access-9zp86\") pod \"aws-ebs-csi-driver-node-nzlz9\" (UID: \"4e3715f2-0c64-43da-87b7-c56ea578e974\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:47.931546 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.931521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9dl\" (UniqueName: \"kubernetes.io/projected/02ff2b42-e953-4f80-baf7-0848eabfa44e-kube-api-access-gb9dl\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:47.931702 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:47.931683 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fpm\" (UniqueName: \"kubernetes.io/projected/0951b37b-f843-421a-aace-547733f217a1-kube-api-access-r6fpm\") pod \"node-resolver-kt555\" (UID: \"0951b37b-f843-421a-aace-547733f217a1\") " pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:48.021515 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-kubernetes\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-conf\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05639699-cbac-42be-bd67-a297f0aba5e3-host\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-konnectivity-ca\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05639699-cbac-42be-bd67-a297f0aba5e3-host\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-kubernetes\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-script-lib\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysconfig\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-sys\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021705 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-conf\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021717 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-systemd-units\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-lib-modules\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021775 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysconfig\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-ovn\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021833 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-lib-modules\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-config\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-sys\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021873 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-cnibin\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-ovn\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-systemd-units\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.021972 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-var-lib-kubelet\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-env-overrides\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-cnibin\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.021984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-hostroot\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-var-lib-kubelet\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-modprobe-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-hostroot\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-systemd\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwd8\" (UniqueName: \"kubernetes.io/projected/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-kube-api-access-nxwd8\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovn-node-metrics-cert\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-os-release\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-kubelet-config\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.022728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-systemd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-kubelet\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-bin\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnj9\" (UniqueName: \"kubernetes.io/projected/472b3a05-5073-4776-84a3-ab34a2a996f1-kube-api-access-kgnj9\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-systemd\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-env-overrides\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-iptables-alerter-script\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-script-lib\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-etc-kubernetes\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022158 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-modprobe-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-systemd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-os-release\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.023427 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovnkube-config\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022578 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-kubelet-config\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022582 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-konnectivity-ca\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-os-release\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022582 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-host\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-os-release\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-kubelet\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-netd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-etc-kubernetes\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4w9\" (UniqueName: \"kubernetes.io/projected/114bfcd6-5390-423e-a0e1-21b42684dc0b-kube-api-access-7c4w9\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-host\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-bin\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.024248 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-cnibin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-cni-binary-copy\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krdnh\" (UniqueName: \"kubernetes.io/projected/a9401913-b94a-417e-b33d-61741c87fbe1-kube-api-access-krdnh\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022818 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-sysctl-d\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-cnibin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.022865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-cni-netd\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023120 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-slash\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-socket-dir-parent\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.023278 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023284 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-slash\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023312 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-multus\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.025133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-multus\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.023343 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:09:48.52332195 +0000 UTC m=+3.020931847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-iptables-alerter-script\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023370 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-socket-dir-parent\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-cni-binary-copy\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-run\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05639699-cbac-42be-bd67-a297f0aba5e3-serviceca\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-689wb\" (UniqueName: \"kubernetes.io/projected/05639699-cbac-42be-bd67-a297f0aba5e3-kube-api-access-689wb\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6d204c-8805-4f43-a42b-9cfb122f41a1-run\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-kubelet\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-system-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-system-cni-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwjlv\" (UniqueName: \"kubernetes.io/projected/6b6d204c-8805-4f43-a42b-9cfb122f41a1-kube-api-access-fwjlv\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-system-cni-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026024 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-multus-certs\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023750 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9401913-b94a-417e-b33d-61741c87fbe1-system-cni-dir\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023794 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-multus-certs\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-k8s-cni-cncf-io\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023863 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-netns\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-run-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-host-slash\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-k8s-cni-cncf-io\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023920 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-etc-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05639699-cbac-42be-bd67-a297f0aba5e3-serviceca\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-kubelet\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-etc-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.026736 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023969 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-log-socket\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-host-slash\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.023991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-run-netns\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-conf-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024006 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-log-socket\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-dbus\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-netns\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-node-log\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-tuned\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-host-run-netns\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-conf-dir\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024173 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-node-log\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-tmp\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/360feee3-2f22-467c-b806-d821d8065b6b-dbus\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.027219 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-agent-certs\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-var-lib-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-bin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/114bfcd6-5390-423e-a0e1-21b42684dc0b-var-lib-openvswitch\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-daemon-config\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/472b3a05-5073-4776-84a3-ab34a2a996f1-host-var-lib-cni-bin\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9401913-b94a-417e-b33d-61741c87fbe1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.024817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/472b3a05-5073-4776-84a3-ab34a2a996f1-multus-daemon-config\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.025735 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/114bfcd6-5390-423e-a0e1-21b42684dc0b-ovn-node-metrics-cert\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.026587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b5a6a57-9345-499b-9d80-9da55bfa0a4c-agent-certs\") pod \"konnectivity-agent-dtr9s\" (UID: \"3b5a6a57-9345-499b-9d80-9da55bfa0a4c\") " pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.026731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-etc-tuned\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.027733 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.026904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6d204c-8805-4f43-a42b-9cfb122f41a1-tmp\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.034951 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.034928 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:48.035091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.034956 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:48.035091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.034970 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:48.035091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.035025 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:09:48.535008272 +0000 UTC m=+3.032618174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:48.037389 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krdnh\" (UniqueName: \"kubernetes.io/projected/a9401913-b94a-417e-b33d-61741c87fbe1-kube-api-access-krdnh\") pod \"multus-additional-cni-plugins-9tw5l\" (UID: \"a9401913-b94a-417e-b33d-61741c87fbe1\") " pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.037520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037503 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4w9\" (UniqueName: \"kubernetes.io/projected/114bfcd6-5390-423e-a0e1-21b42684dc0b-kube-api-access-7c4w9\") pod \"ovnkube-node-5jd26\" (UID: \"114bfcd6-5390-423e-a0e1-21b42684dc0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.037675 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-689wb\" (UniqueName: \"kubernetes.io/projected/05639699-cbac-42be-bd67-a297f0aba5e3-kube-api-access-689wb\") pod \"node-ca-lddn5\" (UID: \"05639699-cbac-42be-bd67-a297f0aba5e3\") " pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.037755 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnj9\" (UniqueName: \"kubernetes.io/projected/472b3a05-5073-4776-84a3-ab34a2a996f1-kube-api-access-kgnj9\") pod \"multus-6pt5b\" (UID: \"472b3a05-5073-4776-84a3-ab34a2a996f1\") " pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.037808 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037755 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwd8\" (UniqueName: \"kubernetes.io/projected/4fe57c4d-216c-411d-84fb-0e2ba1f575f1-kube-api-access-nxwd8\") pod \"iptables-alerter-pl9qz\" (UID: \"4fe57c4d-216c-411d-84fb-0e2ba1f575f1\") " pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.037808 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.037757 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwjlv\" (UniqueName: \"kubernetes.io/projected/6b6d204c-8805-4f43-a42b-9cfb122f41a1-kube-api-access-fwjlv\") pod \"tuned-pgwxd\" (UID: \"6b6d204c-8805-4f43-a42b-9cfb122f41a1\") " pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.127797 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.127743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" Jul 07 14:09:48.139150 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.139130 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kt555" Jul 07 14:09:48.147999 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.147975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pl9qz" Jul 07 14:09:48.167034 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.167016 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:09:48.183873 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.183856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" Jul 07 14:09:48.196759 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.196741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lddn5" Jul 07 14:09:48.210744 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.210727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6pt5b" Jul 07 14:09:48.228677 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.228600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" Jul 07 14:09:48.239624 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.239603 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:09:48.428971 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.428894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:48.429181 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.429014 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:48.429181 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.429068 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.429054086 +0000 UTC m=+3.926663966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:48.529942 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.529916 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.530055 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.530042 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:48.530110 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.530101 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.530085802 +0000 UTC m=+4.027695698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:48.535786 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.535752 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5517289fd68c4c3c5fe705f6265efdd.slice/crio-d38d66c83a738fde18b824c7c7406bf7a5d6d46df9456d39169c5f34a46b73a8 WatchSource:0}: Error finding container d38d66c83a738fde18b824c7c7406bf7a5d6d46df9456d39169c5f34a46b73a8: Status 404 returned error can't find the container with id d38d66c83a738fde18b824c7c7406bf7a5d6d46df9456d39169c5f34a46b73a8 Jul 07 14:09:48.536242 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.536206 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd321df27ccbda0a9064af37cdfbcd85b.slice/crio-0a9f1349806df6c3d917dc00513e956467e6e8a11db41e79b2d879fbdd0d6dc9 WatchSource:0}: Error finding container 0a9f1349806df6c3d917dc00513e956467e6e8a11db41e79b2d879fbdd0d6dc9: Status 404 returned error can't find the container with id 0a9f1349806df6c3d917dc00513e956467e6e8a11db41e79b2d879fbdd0d6dc9 Jul 07 14:09:48.542140 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.542125 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:09:48.573068 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.573044 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3715f2_0c64_43da_87b7_c56ea578e974.slice/crio-cb0ba75a6a17d949691c6ec1b3f6b4fb293b20212f0d98b77cbb66e4696a6f93 WatchSource:0}: Error finding container cb0ba75a6a17d949691c6ec1b3f6b4fb293b20212f0d98b77cbb66e4696a6f93: Status 404 returned error can't find the container with id cb0ba75a6a17d949691c6ec1b3f6b4fb293b20212f0d98b77cbb66e4696a6f93 Jul 07 14:09:48.593470 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.593446 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe57c4d_216c_411d_84fb_0e2ba1f575f1.slice/crio-3c9eab63d877e60245f8a429a007c50e59f34fa1d48ba6f1dfa3b8575e53def7 WatchSource:0}: Error finding container 3c9eab63d877e60245f8a429a007c50e59f34fa1d48ba6f1dfa3b8575e53def7: Status 404 returned error can't find the container with id 3c9eab63d877e60245f8a429a007c50e59f34fa1d48ba6f1dfa3b8575e53def7 Jul 07 14:09:48.596642 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.596599 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6d204c_8805_4f43_a42b_9cfb122f41a1.slice/crio-1728105ab23577cd3091ab4220d59d42b64d1f5e7db96efa496f2a1348ecf1e1 WatchSource:0}: Error finding container 1728105ab23577cd3091ab4220d59d42b64d1f5e7db96efa496f2a1348ecf1e1: Status 404 returned error can't find the container with id 1728105ab23577cd3091ab4220d59d42b64d1f5e7db96efa496f2a1348ecf1e1 Jul 07 14:09:48.597362 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.597343 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9401913_b94a_417e_b33d_61741c87fbe1.slice/crio-06e635b648aa2d77cea7c268c3ed05061f4d840c389106e908d9053b6fc0cd3d WatchSource:0}: Error finding container 06e635b648aa2d77cea7c268c3ed05061f4d840c389106e908d9053b6fc0cd3d: Status 404 returned error can't find the container with id 06e635b648aa2d77cea7c268c3ed05061f4d840c389106e908d9053b6fc0cd3d Jul 07 14:09:48.615870 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:48.615843 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5a6a57_9345_499b_9d80_9da55bfa0a4c.slice/crio-d84a9fee80e8d4c071f13ae703606f3cca4044fb9b0c9c26f28f6e077e8dd7a1 WatchSource:0}: Error finding container d84a9fee80e8d4c071f13ae703606f3cca4044fb9b0c9c26f28f6e077e8dd7a1: Status 404 returned error can't find the container with id d84a9fee80e8d4c071f13ae703606f3cca4044fb9b0c9c26f28f6e077e8dd7a1 Jul 07 14:09:48.630624 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.630596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:48.630764 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.630749 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:48.630804 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.630768 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:48.630804 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.630778 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:48.630867 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.630822 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.630807363 +0000 UTC m=+4.128417257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:48.860951 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.860839 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:46 +0000 UTC" deadline="2028-01-24 13:14:28.759113581 +0000 UTC" Jul 07 14:09:48.860951 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.860893 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13583h4m39.898223022s" Jul 07 14:09:48.994703 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.994668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:48.995321 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:48.994795 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:49.000011 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:48.999967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" event={"ID":"6b6d204c-8805-4f43-a42b-9cfb122f41a1","Type":"ContainerStarted","Data":"1728105ab23577cd3091ab4220d59d42b64d1f5e7db96efa496f2a1348ecf1e1"} Jul 07 14:09:49.001530 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.001507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pl9qz" event={"ID":"4fe57c4d-216c-411d-84fb-0e2ba1f575f1","Type":"ContainerStarted","Data":"3c9eab63d877e60245f8a429a007c50e59f34fa1d48ba6f1dfa3b8575e53def7"} Jul 07 14:09:49.002734 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.002706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" event={"ID":"4e3715f2-0c64-43da-87b7-c56ea578e974","Type":"ContainerStarted","Data":"cb0ba75a6a17d949691c6ec1b3f6b4fb293b20212f0d98b77cbb66e4696a6f93"} Jul 07 14:09:49.003870 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.003841 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"d321df27ccbda0a9064af37cdfbcd85b","Type":"ContainerStarted","Data":"0a9f1349806df6c3d917dc00513e956467e6e8a11db41e79b2d879fbdd0d6dc9"} Jul 07 14:09:49.005616 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.005596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"f5517289fd68c4c3c5fe705f6265efdd","Type":"ContainerStarted","Data":"d38d66c83a738fde18b824c7c7406bf7a5d6d46df9456d39169c5f34a46b73a8"} Jul 07 14:09:49.006723 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.006703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtr9s" event={"ID":"3b5a6a57-9345-499b-9d80-9da55bfa0a4c","Type":"ContainerStarted","Data":"d84a9fee80e8d4c071f13ae703606f3cca4044fb9b0c9c26f28f6e077e8dd7a1"} Jul 07 14:09:49.007673 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.007652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerStarted","Data":"06e635b648aa2d77cea7c268c3ed05061f4d840c389106e908d9053b6fc0cd3d"} Jul 07 14:09:49.012278 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:49.012238 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472b3a05_5073_4776_84a3_ab34a2a996f1.slice/crio-d05b135aa7e04ed7b3f1efa7a5061c4d0f5cff3f4a8abd4d9bff96962f7fa5b3 WatchSource:0}: Error finding container d05b135aa7e04ed7b3f1efa7a5061c4d0f5cff3f4a8abd4d9bff96962f7fa5b3: Status 404 returned error can't find the container with id d05b135aa7e04ed7b3f1efa7a5061c4d0f5cff3f4a8abd4d9bff96962f7fa5b3 Jul 07 14:09:49.436860 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.436818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:49.437029 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.436990 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:49.437092 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.437064 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:51.437041859 +0000 UTC m=+5.934651752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:49.510537 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:49.510478 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05639699_cbac_42be_bd67_a297f0aba5e3.slice/crio-e3533146c12e7aafc50fcfa7a08f3549b983a8411fe724227cd158929ed7dd8b WatchSource:0}: Error finding container e3533146c12e7aafc50fcfa7a08f3549b983a8411fe724227cd158929ed7dd8b: Status 404 returned error can't find the container with id e3533146c12e7aafc50fcfa7a08f3549b983a8411fe724227cd158929ed7dd8b Jul 07 14:09:49.537829 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.537798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:49.538004 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.537985 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:49.538070 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.538049 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:09:51.538031704 +0000 UTC m=+6.035641597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:49.589430 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:09:49.589401 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114bfcd6_5390_423e_a0e1_21b42684dc0b.slice/crio-487fa24929052034f5020e0379824a0d36baf4b0a6d63cc6a97ec1e6780a7601 WatchSource:0}: Error finding container 487fa24929052034f5020e0379824a0d36baf4b0a6d63cc6a97ec1e6780a7601: Status 404 returned error can't find the container with id 487fa24929052034f5020e0379824a0d36baf4b0a6d63cc6a97ec1e6780a7601 Jul 07 14:09:49.638834 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.638778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:49.639006 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.638988 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:49.639094 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.639012 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:49.639094 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.639026 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:49.639094 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.639079 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:09:51.639062491 +0000 UTC m=+6.136672389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:49.994983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.994900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:49.995435 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.995034 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:49.995499 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:49.995452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:49.997612 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:49.997555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:50.019063 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:50.019033 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lddn5" event={"ID":"05639699-cbac-42be-bd67-a297f0aba5e3","Type":"ContainerStarted","Data":"e3533146c12e7aafc50fcfa7a08f3549b983a8411fe724227cd158929ed7dd8b"} Jul 07 14:09:50.038790 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:50.035250 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kt555" event={"ID":"0951b37b-f843-421a-aace-547733f217a1","Type":"ContainerStarted","Data":"8eb9e73ba05c536201cd8d502ef0291918a991aed54d3b20343899f1489d4d1a"} Jul 07 14:09:50.052666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:50.052557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"487fa24929052034f5020e0379824a0d36baf4b0a6d63cc6a97ec1e6780a7601"} Jul 07 14:09:50.068766 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:50.068675 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6pt5b" event={"ID":"472b3a05-5073-4776-84a3-ab34a2a996f1","Type":"ContainerStarted","Data":"d05b135aa7e04ed7b3f1efa7a5061c4d0f5cff3f4a8abd4d9bff96962f7fa5b3"} Jul 07 14:09:50.994628 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:50.994591 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:50.994820 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:50.994734 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:51.462109 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:51.462026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:51.462693 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.462166 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:51.462693 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.462225 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.462208229 +0000 UTC m=+9.959818114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:51.563079 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:51.562484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:51.563079 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.562696 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:51.563079 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.562758 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.562740713 +0000 UTC m=+10.060350600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:51.664334 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:51.663740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:51.664334 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.663907 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:51.664334 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.663925 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:51.664334 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.663938 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:51.664334 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.663996 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.663978096 +0000 UTC m=+10.161587999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:51.995209 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:51.994730 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:51.995209 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.994869 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:51.995721 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:51.995560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:51.995721 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:51.995683 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:52.994805 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:52.994767 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:52.995274 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:52.994917 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:53.995188 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:53.994671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:53.995188 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:53.994821 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:53.995188 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:53.995027 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:53.995188 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:53.995148 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:54.994478 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:54.994442 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:54.994685 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:54.994612 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:55.495086 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:55.495050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:55.495557 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.495290 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:55.495557 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.495358 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:03.495335927 +0000 UTC m=+17.992945826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:55.595750 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:55.595714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:55.595929 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.595890 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:55.595994 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.595974 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:10:03.595953119 +0000 UTC m=+18.093563011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:55.696256 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:55.696176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:55.696410 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.696370 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:55.696410 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.696395 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:55.696410 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.696407 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:55.696594 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.696463 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:03.696444918 +0000 UTC m=+18.194054814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:55.998416 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:55.998377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:55.998616 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.998509 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:55.998616 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:55.998539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:55.998744 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:55.998660 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:56.994404 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:56.994322 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:56.994879 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:56.994444 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:57.995179 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:57.995033 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:57.995179 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:57.995167 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:57.995694 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:57.995507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:57.995755 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:57.995684 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:09:58.994519 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:58.994482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:09:58.994713 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:58.994647 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:09:59.994476 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:59.994436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:09:59.994956 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:09:59.994492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:09:59.994956 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:59.994606 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:09:59.994956 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:09:59.994687 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:00.994815 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:00.994780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:00.995234 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:00.994889 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:01.997081 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:01.997049 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:01.997513 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:01.997086 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:01.997513 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:01.997182 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:01.997513 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:01.997304 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:02.994784 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:02.994749 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:02.994952 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:02.994891 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:03.552713 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:03.552673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:03.553136 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.552831 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:03.553136 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.552910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:19.55289153 +0000 UTC m=+34.050501429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:03.653442 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:03.653405 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:03.654142 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.653856 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:03.654142 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.653997 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:10:19.653958192 +0000 UTC m=+34.151568104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:03.755454 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:03.755406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:03.755646 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.755602 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:03.755646 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.755632 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:03.755766 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.755648 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:03.755766 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.755709 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:19.75569245 +0000 UTC m=+34.253302330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:03.995086 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:03.995058 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:03.995237 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.995162 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:03.995237 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:03.995216 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:03.995328 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:03.995311 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:04.995025 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:04.994989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:04.995460 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:04.995098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:05.997006 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:05.996826 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:05.997437 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:05.996828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:05.997437 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:05.997109 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:05.997437 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:05.997201 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:06.994431 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:06.994393 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:06.994604 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:06.994524 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:07.994669 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:07.994627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:07.995106 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:07.994669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:07.995106 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:07.994746 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:07.995106 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:07.994952 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:08.994210 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:08.994152 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:08.994313 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:08.994247 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:09.106852 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.106815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" event={"ID":"6b6d204c-8805-4f43-a42b-9cfb122f41a1","Type":"ContainerStarted","Data":"6c706faba91868f40a413e80468f62068301c1fdb2a59ef97ec6c23aa3179499"} Jul 07 14:10:09.108254 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.108227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6pt5b" event={"ID":"472b3a05-5073-4776-84a3-ab34a2a996f1","Type":"ContainerStarted","Data":"48bc3c28e35e2a12d35a5daf9c1ba110786f2db183557c2dc1e3c9ad672b0df8"} Jul 07 14:10:09.109567 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.109547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"d321df27ccbda0a9064af37cdfbcd85b","Type":"ContainerStarted","Data":"c830efe72b9c29e82e9bdc5df9491176f303a26255f92f7d3fa2beebff29444a"} Jul 07 14:10:09.126815 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.126771 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pgwxd" podStartSLOduration=3.050363451 podStartE2EDuration="23.126759807s" totalImagesPullingTime="20.076396356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:09.126615124 +0000 UTC m=+23.624225022" watchObservedRunningTime="2026-07-07 14:10:09.126759807 +0000 UTC m=+23.624369708" Jul 07 14:10:09.145354 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.145317 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" podStartSLOduration=23.145307626 podStartE2EDuration="23.145307626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:09.144833606 +0000 UTC m=+23.642443506" watchObservedRunningTime="2026-07-07 14:10:09.145307626 +0000 UTC m=+23.642917526" Jul 07 14:10:09.166376 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.166338 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6pt5b" podStartSLOduration=3.49206936 podStartE2EDuration="23.166326807s" totalImagesPullingTime="19.674257447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:09.166109969 +0000 UTC m=+23.663719870" watchObservedRunningTime="2026-07-07 14:10:09.166326807 +0000 UTC m=+23.663936708" Jul 07 14:10:09.994295 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.994055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:09.994632 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:09.994119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:09.994632 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:09.994385 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:09.994632 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:09.994465 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:10.114820 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"bc1129a113d000a6b0f587e99d9e84f6034195027a66b8ce4797448ee0ba31f7"} Jul 07 14:10:10.114820 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114810 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"6c69a9247bce8ea67b18392790f0a1e080f82e64162281e4c3dfd6613eb6d5f6"} Jul 07 14:10:10.115605 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"36dec588f4b2ebff3a2f1b2dc54a45358a27071ebca2797c24e902a2e8bb23fb"} Jul 07 14:10:10.115605 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114880 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"c449de6f6c9c7d1f80f642d68620b6d600ca462634036321c5dc91a30584302a"} Jul 07 14:10:10.115605 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"3a1c295daccbf7d70f92b42ec47b07cbe9b1913f0e2be446f9a20d840074eb04"} Jul 07 14:10:10.115605 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.114939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"f87a9b9c95259acecb9d6eab21fb678ebc985797621f613090e9d1874c796a65"} Jul 07 14:10:10.116220 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.116198 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="cbac42548b66e3c8d50df90c0b54b8f721838de0f30f018f1a95bbeb7ef577af" exitCode=0 Jul 07 14:10:10.116306 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.116262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"cbac42548b66e3c8d50df90c0b54b8f721838de0f30f018f1a95bbeb7ef577af"} Jul 07 14:10:10.117854 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.117827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pl9qz" event={"ID":"4fe57c4d-216c-411d-84fb-0e2ba1f575f1","Type":"ContainerStarted","Data":"668027c4d14f05c6c7dbda33ccafe261e7da7b07a570a611df8fbc24e5b0f4bd"} Jul 07 14:10:10.119356 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.119332 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lddn5" event={"ID":"05639699-cbac-42be-bd67-a297f0aba5e3","Type":"ContainerStarted","Data":"85416ae1da915734c03ca624f1d582fd960a12cb4b1c36f345f51807218018a9"} Jul 07 14:10:10.120564 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.120546 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kt555" event={"ID":"0951b37b-f843-421a-aace-547733f217a1","Type":"ContainerStarted","Data":"317b0f0724d514934deebbffd770337ea42341ccee563dff452ba1bf777dc620"} Jul 07 14:10:10.121847 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.121828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtr9s" event={"ID":"3b5a6a57-9345-499b-9d80-9da55bfa0a4c","Type":"ContainerStarted","Data":"4df1fa2f83071f46ddb89e73d02acdb7015eb6e2ae8192ea805de71b14a1ccd3"} Jul 07 14:10:10.123809 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.123789 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" event={"ID":"4e3715f2-0c64-43da-87b7-c56ea578e974","Type":"ContainerStarted","Data":"c15af374cc9e65cb7c0ca3805a9e8c8fb56cfd148209af20acd94380eae9669e"} Jul 07 14:10:10.125107 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.125087 2560 generic.go:356] "Generic (PLEG): container finished" podID="f5517289fd68c4c3c5fe705f6265efdd" containerID="ab217bda45103a7ad4d4db1468309cb388c84c5174def5fb63276e607e0416e9" exitCode=0 Jul 07 14:10:10.125196 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.125169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"f5517289fd68c4c3c5fe705f6265efdd","Type":"ContainerDied","Data":"ab217bda45103a7ad4d4db1468309cb388c84c5174def5fb63276e607e0416e9"} Jul 07 14:10:10.159535 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.159333 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dtr9s" podStartSLOduration=8.841600075 podStartE2EDuration="24.159319556s" totalImagesPullingTime="15.317719481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:10.159286332 +0000 UTC m=+24.656896232" watchObservedRunningTime="2026-07-07 14:10:10.159319556 +0000 UTC m=+24.656929457" Jul 07 14:10:10.176936 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.176883 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kt555" podStartSLOduration=4.82464693 podStartE2EDuration="24.176865775s" totalImagesPullingTime="19.352218845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:10.176529893 +0000 UTC m=+24.674139795" watchObservedRunningTime="2026-07-07 14:10:10.176865775 +0000 UTC m=+24.674475677" Jul 07 14:10:10.198378 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.198338 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pl9qz" podStartSLOduration=4.135961431 podStartE2EDuration="24.198324845s" totalImagesPullingTime="20.062363414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:10.19815001 +0000 UTC m=+24.695759912" watchObservedRunningTime="2026-07-07 14:10:10.198324845 +0000 UTC m=+24.695934747" Jul 07 14:10:10.217536 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.217487 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lddn5" podStartSLOduration=5.052453004 podStartE2EDuration="24.217470179s" totalImagesPullingTime="19.165017175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:10.216816982 +0000 UTC m=+24.714426884" watchObservedRunningTime="2026-07-07 14:10:10.217470179 +0000 UTC m=+24.715080083" Jul 07 14:10:10.356997 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.356961 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:10.436835 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.436803 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:10.994695 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:10.994230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:10.994695 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:10.994343 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:11.077547 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.077524 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:10:11.129400 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.129376 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" event={"ID":"4e3715f2-0c64-43da-87b7-c56ea578e974","Type":"ContainerStarted","Data":"a822bfb3241165439766dc7303d833eb139abc213d2086300aad57253a58313c"} Jul 07 14:10:11.131085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.131060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"f5517289fd68c4c3c5fe705f6265efdd","Type":"ContainerStarted","Data":"866067870beecd323c69da5bd1476903d4ae8aece07bd03f6de5a4686b5093df"} Jul 07 14:10:11.149632 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.149563 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" podStartSLOduration=25.149551146 podStartE2EDuration="25.149551146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:11.149230471 +0000 UTC m=+25.646840373" watchObservedRunningTime="2026-07-07 14:10:11.149551146 +0000 UTC m=+25.647161046" Jul 07 14:10:11.884756 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.884639 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:10:11.077544079Z","UUID":"68f0145f-8e11-4713-90b1-2b0eaa9c7615","Handler":null,"Name":"","Endpoint":""} Jul 07 14:10:11.886401 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.886379 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:10:11.886498 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.886427 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:10:11.994877 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.994837 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:11.994877 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:11.994863 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:11.995060 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:11.994965 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:11.995126 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:11.995102 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:12.137567 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:12.137529 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"53a6c625e3d7acfa4d43cd42d692a67c9ce39745d1c30add384fb25c6e02e6eb"} Jul 07 14:10:12.994390 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:12.994356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:12.994594 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:12.994460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:13.142057 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.142018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" event={"ID":"4e3715f2-0c64-43da-87b7-c56ea578e974","Type":"ContainerStarted","Data":"f6e1e77ea147785771c69d24c89944889d7731bfe76c1d7d107f7eff180209bc"} Jul 07 14:10:13.164484 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.164432 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzlz9" podStartSLOduration=4.724013404 podStartE2EDuration="27.164419383s" totalImagesPullingTime="22.440405979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.163958022 +0000 UTC m=+27.661567924" watchObservedRunningTime="2026-07-07 14:10:13.164419383 +0000 UTC m=+27.662029283" Jul 07 14:10:13.467381 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.467346 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:10:13.467979 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.467962 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:10:13.747350 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.747260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:13.851101 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.851063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:13.994387 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.994350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:13.994827 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:13.994355 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:13.994827 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:13.994488 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:13.994827 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:13.994591 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:14.150500 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.150296 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:10:14.150813 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.150554 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dtr9s" Jul 07 14:10:14.228018 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.227990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:14.767279 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.767248 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:14.840913 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.840877 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:14.905763 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.905721 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:14.994684 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:14.994653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:14.994841 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:14.994792 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:15.156722 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.156683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" event={"ID":"114bfcd6-5390-423e-a0e1-21b42684dc0b","Type":"ContainerStarted","Data":"86fec81747b4c1952f4c2e17fd1cf55faa9f01e6c30ddfc3043842cd55d1ecfe"} Jul 07 14:10:15.185534 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.185479 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" podStartSLOduration=9.561500583 podStartE2EDuration="29.185462175s" totalImagesPullingTime="19.623961592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.185380896 +0000 UTC m=+29.682990810" watchObservedRunningTime="2026-07-07 14:10:15.185462175 +0000 UTC m=+29.683072075" Jul 07 14:10:15.667784 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.667744 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:15.768409 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.768379 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:15.995622 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.995533 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:15.995764 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:15.995658 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:15.995764 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:15.995716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:15.995952 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:15.995762 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:16.161103 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.160906 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:16.161103 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.160997 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:16.161103 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.161048 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:16.180019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.179893 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:16.181304 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.181269 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:16.493558 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.493302 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7svr"] Jul 07 14:10:16.493724 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.493706 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:16.493856 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:16.493834 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:16.493998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.493975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkpwv"] Jul 07 14:10:16.494117 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.494094 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:16.494237 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:16.494196 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:16.494606 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.494566 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42d9m"] Jul 07 14:10:16.494690 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:16.494654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:16.494738 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:16.494722 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:17.165628 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:17.165591 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="58a3f34e66db4873b6559be3cdee870f7329a929a5d1c95daa090b2a792e8249" exitCode=0 Jul 07 14:10:17.166037 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:17.165667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"58a3f34e66db4873b6559be3cdee870f7329a929a5d1c95daa090b2a792e8249"} Jul 07 14:10:17.995175 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:17.995129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:17.995349 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:17.995198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:17.995349 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:17.995331 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:17.995471 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:17.995367 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:17.995471 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:17.995443 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:17.995734 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:17.995526 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:18.616418 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:18.616391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:19.172740 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.172708 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="2cc37a32ff91d7f90037b1bc4a1ca2ad81440c838fd8d7121a6fde03f6b53266" exitCode=0 Jul 07 14:10:19.172910 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.172758 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"2cc37a32ff91d7f90037b1bc4a1ca2ad81440c838fd8d7121a6fde03f6b53266"} Jul 07 14:10:19.569741 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.569653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:19.569881 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.569761 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:19.569881 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.569809 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs podName:02ff2b42-e953-4f80-baf7-0848eabfa44e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.569797073 +0000 UTC m=+66.067406951 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs") pod "network-metrics-daemon-d7svr" (UID: "02ff2b42-e953-4f80-baf7-0848eabfa44e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:19.670884 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.670828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:19.671308 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.671006 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:19.671308 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.671077 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret podName:360feee3-2f22-467c-b806-d821d8065b6b nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.67106188 +0000 UTC m=+66.168671764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret") pod "global-pull-secret-syncer-zkpwv" (UID: "360feee3-2f22-467c-b806-d821d8065b6b") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:19.771428 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.771390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:19.771608 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.771538 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:19.771608 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.771553 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:19.771608 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.771563 2560 projected.go:196] Error preparing data for projected volume kube-api-access-pvjcc for pod openshift-network-diagnostics/network-check-target-42d9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:19.771704 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.771642 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc podName:151ee79c-f287-4642-91bf-b14d7e8ee46c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.771626847 +0000 UTC m=+66.269236748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvjcc" (UniqueName: "kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc") pod "network-check-target-42d9m" (UID: "151ee79c-f287-4642-91bf-b14d7e8ee46c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:19.994414 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.994381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:19.994414 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.994404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:19.994643 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.994516 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkpwv" podUID="360feee3-2f22-467c-b806-d821d8065b6b" Jul 07 14:10:19.995009 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.994980 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42d9m" podUID="151ee79c-f287-4642-91bf-b14d7e8ee46c" Jul 07 14:10:19.995098 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:19.995052 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:19.995163 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:19.995145 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7svr" podUID="02ff2b42-e953-4f80-baf7-0848eabfa44e" Jul 07 14:10:20.176950 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:20.176920 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="7befa96d5c938f9a7a58590f1a9d72445712be72d8bbd6bc5db615932fc805e8" exitCode=0 Jul 07 14:10:20.177112 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:20.176980 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"7befa96d5c938f9a7a58590f1a9d72445712be72d8bbd6bc5db615932fc805e8"} Jul 07 14:10:20.874997 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:20.874954 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:20.971981 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:20.971927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:21.761894 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.761658 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeReady" Jul 07 14:10:21.762040 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.762030 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:10:21.816681 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.816594 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:10:21.819927 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.819905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.822845 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.822617 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:10:21.822845 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.822674 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:10:21.823010 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.822917 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:10:21.823269 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.823253 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bstgj\"" Jul 07 14:10:21.832691 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.832665 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:10:21.844114 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.844082 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:10:21.846615 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.846591 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wtq62"] Jul 07 14:10:21.851200 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.851180 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s8thk"] Jul 07 14:10:21.851303 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.851272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:21.853861 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.853833 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:10:21.853947 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.853858 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-njxhm\"" Jul 07 14:10:21.853947 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.853863 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:10:21.854297 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.854282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:21.856843 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.856792 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:10:21.856843 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.856791 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:10:21.857157 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.857134 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:10:21.857258 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.857247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2bzq9\"" Jul 07 14:10:21.865271 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.865250 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtq62"] Jul 07 14:10:21.866105 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.866080 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s8thk"] Jul 07 14:10:21.986213 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/963a6b20-2e7d-4210-aa24-82f939e660f1-cert\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntt7q\" (UniqueName: \"kubernetes.io/projected/963a6b20-2e7d-4210-aa24-82f939e660f1-kube-api-access-ntt7q\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llcnf\" (UniqueName: \"kubernetes.io/projected/12efb052-f435-486c-b580-fc65a24ac9a4-kube-api-access-llcnf\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12efb052-f435-486c-b580-fc65a24ac9a4-tmp-dir\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55rr\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12efb052-f435-486c-b580-fc65a24ac9a4-config-volume\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.986670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.986604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:21.994270 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.994244 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:21.994270 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.994268 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:21.994469 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.994273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:21.997260 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:21.997382 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zlrf\"" Jul 07 14:10:21.997432 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997391 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66bkv\"" Jul 07 14:10:21.997617 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997600 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:21.997753 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997735 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:21.997994 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.997972 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:21.998923 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:21.998894 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.087787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.087707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/963a6b20-2e7d-4210-aa24-82f939e660f1-cert\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:22.087787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.087736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntt7q\" (UniqueName: \"kubernetes.io/projected/963a6b20-2e7d-4210-aa24-82f939e660f1-kube-api-access-ntt7q\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:22.087787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.087765 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.087787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.087786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.088034 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.087803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llcnf\" (UniqueName: \"kubernetes.io/projected/12efb052-f435-486c-b580-fc65a24ac9a4-kube-api-access-llcnf\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.088034 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.087891 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:22.088034 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.087915 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5694b5c4b8-sf5dg: secret "image-registry-tls" not found Jul 07 14:10:22.088034 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.087972 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls podName:d962e74f-0cb3-4f0e-bceb-8a64f2fb0146 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:22.587951625 +0000 UTC m=+37.085561519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls") pod "image-registry-5694b5c4b8-sf5dg" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146") : secret "image-registry-tls" not found Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.088056 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.088117 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls podName:12efb052-f435-486c-b580-fc65a24ac9a4 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:22.588099586 +0000 UTC m=+37.085709480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls") pod "dns-default-wtq62" (UID: "12efb052-f435-486c-b580-fc65a24ac9a4") : secret "dns-default-metrics-tls" not found Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12efb052-f435-486c-b580-fc65a24ac9a4-tmp-dir\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088238 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55rr\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12efb052-f435-486c-b580-fc65a24ac9a4-config-volume\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088312 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088520 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088468 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.088842 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.088547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12efb052-f435-486c-b580-fc65a24ac9a4-tmp-dir\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.089109 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.089066 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12efb052-f435-486c-b580-fc65a24ac9a4-config-volume\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.089459 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.089435 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.089559 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.089463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.093004 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.092960 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.093104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.093063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.093104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.093073 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/963a6b20-2e7d-4210-aa24-82f939e660f1-cert\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:22.117433 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.117406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llcnf\" (UniqueName: \"kubernetes.io/projected/12efb052-f435-486c-b580-fc65a24ac9a4-kube-api-access-llcnf\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.117834 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.117803 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55rr\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.118007 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.117989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntt7q\" (UniqueName: \"kubernetes.io/projected/963a6b20-2e7d-4210-aa24-82f939e660f1-kube-api-access-ntt7q\") pod \"ingress-canary-s8thk\" (UID: \"963a6b20-2e7d-4210-aa24-82f939e660f1\") " pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:22.122599 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.122556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.169715 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.169685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s8thk" Jul 07 14:10:22.185086 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.185060 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kh9z5"] Jul 07 14:10:22.186322 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.186294 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.189318 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.189300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.195169 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.195150 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:10:22.195323 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.195169 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:10:22.195323 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.195189 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:10:22.195434 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.195359 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhpqs\"" Jul 07 14:10:22.195434 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.195403 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:10:22.224277 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.224194 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh9z5"] Jul 07 14:10:22.290679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.290421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.290679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.290474 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/162038fe-c332-4579-8404-6ba4f983382a-crio-socket\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.290679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.290508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrqq\" (UniqueName: \"kubernetes.io/projected/162038fe-c332-4579-8404-6ba4f983382a-kube-api-access-gfrqq\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.290679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.290588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/162038fe-c332-4579-8404-6ba4f983382a-data-volume\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.290679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.290615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.314451 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.314411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.391826 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.391781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.391992 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.391843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/162038fe-c332-4579-8404-6ba4f983382a-crio-socket\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.391992 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.391872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrqq\" (UniqueName: \"kubernetes.io/projected/162038fe-c332-4579-8404-6ba4f983382a-kube-api-access-gfrqq\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.391992 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.391926 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:22.391992 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.391990 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:22.891974313 +0000 UTC m=+37.389584191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:22.392217 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.391927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/162038fe-c332-4579-8404-6ba4f983382a-data-volume\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.392217 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.392066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.392217 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.392126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/162038fe-c332-4579-8404-6ba4f983382a-crio-socket\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.392217 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.392162 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:22.392388 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.392229 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:22.89221851 +0000 UTC m=+37.389828408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : configmap "kube-rbac-proxy" not found Jul 07 14:10:22.392388 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.392310 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/162038fe-c332-4579-8404-6ba4f983382a-data-volume\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.405912 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.405880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrqq\" (UniqueName: \"kubernetes.io/projected/162038fe-c332-4579-8404-6ba4f983382a-kube-api-access-gfrqq\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.522385 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.522356 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.531840 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.531813 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s8thk"] Jul 07 14:10:22.535879 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:22.535847 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963a6b20_2e7d_4210_aa24_82f939e660f1.slice/crio-beb62e87eabe8a43ca0b23da20795eed9b6ba59b03244c894b019021f33f137e WatchSource:0}: Error finding container beb62e87eabe8a43ca0b23da20795eed9b6ba59b03244c894b019021f33f137e: Status 404 returned error can't find the container with id beb62e87eabe8a43ca0b23da20795eed9b6ba59b03244c894b019021f33f137e Jul 07 14:10:22.553689 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.553662 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47"] Jul 07 14:10:22.560071 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.560045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" Jul 07 14:10:22.562809 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.562785 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tqjps\"" Jul 07 14:10:22.562809 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.562798 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 14:10:22.562944 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.562797 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 14:10:22.569216 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.569194 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47"] Jul 07 14:10:22.594395 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.594365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:22.594559 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.594408 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:22.594559 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.594515 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:22.594559 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.594535 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5694b5c4b8-sf5dg: secret "image-registry-tls" not found Jul 07 14:10:22.594699 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.594597 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:22.594699 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.594617 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls podName:d962e74f-0cb3-4f0e-bceb-8a64f2fb0146 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:23.594596612 +0000 UTC m=+38.092206509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls") pod "image-registry-5694b5c4b8-sf5dg" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146") : secret "image-registry-tls" not found Jul 07 14:10:22.594699 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.594643 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls podName:12efb052-f435-486c-b580-fc65a24ac9a4 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:23.59462398 +0000 UTC m=+38.092233873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls") pod "dns-default-wtq62" (UID: "12efb052-f435-486c-b580-fc65a24ac9a4") : secret "dns-default-metrics-tls" not found Jul 07 14:10:22.602184 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.602160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.678144 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.678063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.695129 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.695101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rzmt\" (UniqueName: \"kubernetes.io/projected/ccde8dfa-a575-401e-945c-62ccc9045169-kube-api-access-9rzmt\") pod \"migrator-d57d58cc9-s2p47\" (UID: \"ccde8dfa-a575-401e-945c-62ccc9045169\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" Jul 07 14:10:22.790133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.790097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.796279 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.796253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rzmt\" (UniqueName: \"kubernetes.io/projected/ccde8dfa-a575-401e-945c-62ccc9045169-kube-api-access-9rzmt\") pod \"migrator-d57d58cc9-s2p47\" (UID: \"ccde8dfa-a575-401e-945c-62ccc9045169\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" Jul 07 14:10:22.806786 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.806762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rzmt\" (UniqueName: \"kubernetes.io/projected/ccde8dfa-a575-401e-945c-62ccc9045169-kube-api-access-9rzmt\") pod \"migrator-d57d58cc9-s2p47\" (UID: \"ccde8dfa-a575-401e-945c-62ccc9045169\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" Jul 07 14:10:22.869550 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.869519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" Jul 07 14:10:22.887111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.887070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.897397 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.897369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.897516 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:22.897495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:22.897609 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.897505 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:22.897719 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.897672 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:23.897651115 +0000 UTC m=+38.395261010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : configmap "kube-rbac-proxy" not found Jul 07 14:10:22.897719 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.897674 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:22.897894 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:22.897730 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:23.897719973 +0000 UTC m=+38.395329866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:23.018285 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.018249 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47"] Jul 07 14:10:23.021932 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:23.021884 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccde8dfa_a575_401e_945c_62ccc9045169.slice/crio-5ac38af1aa9d7714134515c677f38bd4bb9caa6b0625225e8eb88433f80ac240 WatchSource:0}: Error finding container 5ac38af1aa9d7714134515c677f38bd4bb9caa6b0625225e8eb88433f80ac240: Status 404 returned error can't find the container with id 5ac38af1aa9d7714134515c677f38bd4bb9caa6b0625225e8eb88433f80ac240 Jul 07 14:10:23.185692 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.185639 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" event={"ID":"ccde8dfa-a575-401e-945c-62ccc9045169","Type":"ContainerStarted","Data":"5ac38af1aa9d7714134515c677f38bd4bb9caa6b0625225e8eb88433f80ac240"} Jul 07 14:10:23.186870 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.186835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s8thk" event={"ID":"963a6b20-2e7d-4210-aa24-82f939e660f1","Type":"ContainerStarted","Data":"beb62e87eabe8a43ca0b23da20795eed9b6ba59b03244c894b019021f33f137e"} Jul 07 14:10:23.602772 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.602735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:23.602954 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.602776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:23.602954 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.602917 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:23.602954 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.602944 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5694b5c4b8-sf5dg: secret "image-registry-tls" not found Jul 07 14:10:23.603131 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.602974 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:23.603131 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.602997 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls podName:d962e74f-0cb3-4f0e-bceb-8a64f2fb0146 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.602982767 +0000 UTC m=+40.100592646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls") pod "image-registry-5694b5c4b8-sf5dg" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146") : secret "image-registry-tls" not found Jul 07 14:10:23.603131 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.603046 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls podName:12efb052-f435-486c-b580-fc65a24ac9a4 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.603026488 +0000 UTC m=+40.100636380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls") pod "dns-default-wtq62" (UID: "12efb052-f435-486c-b580-fc65a24ac9a4") : secret "dns-default-metrics-tls" not found Jul 07 14:10:23.838353 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.838244 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kt555_0951b37b-f843-421a-aace-547733f217a1/dns-node-resolver/0.log" Jul 07 14:10:23.905444 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.905413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:23.905644 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:23.905525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:23.905644 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.905598 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:23.905772 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.905666 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:23.905772 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.905674 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.905653019 +0000 UTC m=+40.403262913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : configmap "kube-rbac-proxy" not found Jul 07 14:10:23.905772 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:23.905716 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.905701829 +0000 UTC m=+40.403311725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:24.397923 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.397891 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-np4tw"] Jul 07 14:10:24.418968 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.418461 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-np4tw"] Jul 07 14:10:24.418968 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.418604 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.422146 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.422120 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 14:10:24.422358 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.422335 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2h7dq\"" Jul 07 14:10:24.423468 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.423449 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 14:10:24.423601 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.423479 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 14:10:24.423601 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.423518 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 14:10:24.433218 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.433192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:24.506478 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.506435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:24.511456 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.511426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/507f8642-583f-4415-9fe4-45754b3db415-signing-key\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.511456 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.511458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/507f8642-583f-4415-9fe4-45754b3db415-signing-cabundle\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.511635 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.511537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghtn9\" (UniqueName: \"kubernetes.io/projected/507f8642-583f-4415-9fe4-45754b3db415-kube-api-access-ghtn9\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.612191 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.612161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/507f8642-583f-4415-9fe4-45754b3db415-signing-key\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.612191 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.612198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/507f8642-583f-4415-9fe4-45754b3db415-signing-cabundle\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.612468 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.612441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtn9\" (UniqueName: \"kubernetes.io/projected/507f8642-583f-4415-9fe4-45754b3db415-kube-api-access-ghtn9\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.612957 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.612934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/507f8642-583f-4415-9fe4-45754b3db415-signing-cabundle\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.615511 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.615492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/507f8642-583f-4415-9fe4-45754b3db415-signing-key\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.643953 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.643925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghtn9\" (UniqueName: \"kubernetes.io/projected/507f8642-583f-4415-9fe4-45754b3db415-kube-api-access-ghtn9\") pod \"service-ca-758f599c5-np4tw\" (UID: \"507f8642-583f-4415-9fe4-45754b3db415\") " pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:24.644418 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.644393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lddn5_05639699-cbac-42be-bd67-a297f0aba5e3/node-ca/0.log" Jul 07 14:10:24.730053 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:24.729979 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-np4tw" Jul 07 14:10:25.620632 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:25.620588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:25.620648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.620688 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.620718 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5694b5c4b8-sf5dg: secret "image-registry-tls" not found Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.620779 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls podName:d962e74f-0cb3-4f0e-bceb-8a64f2fb0146 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.62076118 +0000 UTC m=+44.118371082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls") pod "image-registry-5694b5c4b8-sf5dg" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146") : secret "image-registry-tls" not found Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.620785 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:25.621093 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.620823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls podName:12efb052-f435-486c-b580-fc65a24ac9a4 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.620809944 +0000 UTC m=+44.118419841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls") pod "dns-default-wtq62" (UID: "12efb052-f435-486c-b580-fc65a24ac9a4") : secret "dns-default-metrics-tls" not found Jul 07 14:10:25.744344 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:25.744307 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:25.923714 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:25.923679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:25.923871 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:25.923812 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:25.923976 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.923959 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:25.924041 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.924031 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.924013712 +0000 UTC m=+44.421623604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:25.924154 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.924138 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:25.924231 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:25.924204 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.924186643 +0000 UTC m=+44.421796536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : configmap "kube-rbac-proxy" not found Jul 07 14:10:27.472440 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:27.472403 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:27.608984 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:27.608960 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-np4tw"] Jul 07 14:10:27.613046 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:27.613020 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507f8642_583f_4415_9fe4_45754b3db415.slice/crio-815c244b914fae93a5115e563a91a8844303a707904f8523d79eb8771800d65f WatchSource:0}: Error finding container 815c244b914fae93a5115e563a91a8844303a707904f8523d79eb8771800d65f: Status 404 returned error can't find the container with id 815c244b914fae93a5115e563a91a8844303a707904f8523d79eb8771800d65f Jul 07 14:10:28.198920 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.198861 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-np4tw" event={"ID":"507f8642-583f-4415-9fe4-45754b3db415","Type":"ContainerStarted","Data":"815c244b914fae93a5115e563a91a8844303a707904f8523d79eb8771800d65f"} Jul 07 14:10:28.202315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.202284 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="7c52620a921928c24cb230ed549cb7951868c7f5a7a3adec33052ede825c3f8b" exitCode=0 Jul 07 14:10:28.202436 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.202364 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"7c52620a921928c24cb230ed549cb7951868c7f5a7a3adec33052ede825c3f8b"} Jul 07 14:10:28.204292 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.204204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" event={"ID":"ccde8dfa-a575-401e-945c-62ccc9045169","Type":"ContainerStarted","Data":"9fafe9668deb59fb71a58abb40cc08ce58d068af5f7ce949547786b66967700a"} Jul 07 14:10:28.204292 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.204258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" event={"ID":"ccde8dfa-a575-401e-945c-62ccc9045169","Type":"ContainerStarted","Data":"1e15e955edb983dac2f6c48d2393c0d76da23df112e9893753ed5de270ea57c5"} Jul 07 14:10:28.205741 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.205717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s8thk" event={"ID":"963a6b20-2e7d-4210-aa24-82f939e660f1","Type":"ContainerStarted","Data":"ca32b8adc973c55d669024901ca383cd60a46a719e9fe510e10b1c264a2b2963"} Jul 07 14:10:28.273369 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.273307 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s8thk" podStartSLOduration=2.33815667 podStartE2EDuration="7.273286623s" totalImagesPullingTime="4.935129953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:28.273031092 +0000 UTC m=+42.770640995" watchObservedRunningTime="2026-07-07 14:10:28.273286623 +0000 UTC m=+42.770896525" Jul 07 14:10:28.298776 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:28.298728 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-s2p47" podStartSLOduration=1.8468186690000001 podStartE2EDuration="6.298712062s" totalImagesPullingTime="4.451893393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:28.296745447 +0000 UTC m=+42.794355348" watchObservedRunningTime="2026-07-07 14:10:28.298712062 +0000 UTC m=+42.796321963" Jul 07 14:10:29.194379 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.194341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:29.211843 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.211811 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9401913-b94a-417e-b33d-61741c87fbe1" containerID="f6fbe20f3835f7febf73348d1eec8d158b2a7617e2c8cb67bbb31f9b9a352cf8" exitCode=0 Jul 07 14:10:29.211996 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.211893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerDied","Data":"f6fbe20f3835f7febf73348d1eec8d158b2a7617e2c8cb67bbb31f9b9a352cf8"} Jul 07 14:10:29.655980 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.655950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:29.656110 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.655995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:29.656110 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.656072 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:29.656110 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.656089 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5694b5c4b8-sf5dg: secret "image-registry-tls" not found Jul 07 14:10:29.656213 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.656135 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls podName:d962e74f-0cb3-4f0e-bceb-8a64f2fb0146 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.656121061 +0000 UTC m=+52.153730939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls") pod "image-registry-5694b5c4b8-sf5dg" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146") : secret "image-registry-tls" not found Jul 07 14:10:29.656213 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.656088 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:29.656282 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.656214 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls podName:12efb052-f435-486c-b580-fc65a24ac9a4 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.656196749 +0000 UTC m=+52.153806647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls") pod "dns-default-wtq62" (UID: "12efb052-f435-486c-b580-fc65a24ac9a4") : secret "dns-default-metrics-tls" not found Jul 07 14:10:29.958518 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.958489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:29.958625 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:29.958559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:29.958691 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.958663 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:29.958733 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.958717 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:29.958770 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.958740 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.958724939 +0000 UTC m=+52.456334818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : configmap "kube-rbac-proxy" not found Jul 07 14:10:29.958770 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:29.958765 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.958753582 +0000 UTC m=+52.456363478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:30.216555 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:30.216521 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-np4tw" event={"ID":"507f8642-583f-4415-9fe4-45754b3db415","Type":"ContainerStarted","Data":"b3a791865ec3b40c637037e3a6cca4872ed3acc2ffd4bf16402f454e87594934"} Jul 07 14:10:30.220012 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:30.219988 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" event={"ID":"a9401913-b94a-417e-b33d-61741c87fbe1","Type":"ContainerStarted","Data":"9e2347bcd19d5b3b431a757cf7aefe5c2ee65ab357797ed35e86e7aa749a5396"} Jul 07 14:10:30.247852 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:30.247805 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-np4tw" podStartSLOduration=4.004799147 podStartE2EDuration="6.247788817s" totalImagesPullingTime="2.24298967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:30.246007209 +0000 UTC m=+44.743617112" watchObservedRunningTime="2026-07-07 14:10:30.247788817 +0000 UTC m=+44.745398744" Jul 07 14:10:30.286414 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:30.286358 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9tw5l" podStartSLOduration=9.153922947 podStartE2EDuration="44.286337583s" totalImagesPullingTime="35.132414636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:30.285681666 +0000 UTC m=+44.783291568" watchObservedRunningTime="2026-07-07 14:10:30.286337583 +0000 UTC m=+44.783947485" Jul 07 14:10:30.869637 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:30.869599 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.080046 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.080009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.324062 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.324024 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.449894 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.449864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.564621 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.564585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.764940 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.764899 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:31.983110 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:31.983067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:32.987164 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:32.987125 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:33.356479 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:33.356398 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:33.579629 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:33.579601 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:33.767457 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:33.767426 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:33.973088 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:33.973057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:34.551804 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:34.551772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:34.836973 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:34.836897 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:34.956067 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:34.956033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.267512 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.267479 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.367565 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.367535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.555393 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.555318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.618542 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.618513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.756949 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.756922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:35.992998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:35.992967 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:36.970356 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:36.970313 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.147128 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.147098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.551133 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.551061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.683895 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.683853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.719017 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.718986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:37.719189 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.719025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:37.722673 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.722649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"image-registry-5694b5c4b8-sf5dg\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:37.722816 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.722655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12efb052-f435-486c-b580-fc65a24ac9a4-metrics-tls\") pod \"dns-default-wtq62\" (UID: \"12efb052-f435-486c-b580-fc65a24ac9a4\") " pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:37.731476 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.731454 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:37.749747 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.749676 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.762222 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.762197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:37.888371 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.888334 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:37.921833 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.921806 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:10:37.925097 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:37.925074 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd962e74f_0cb3_4f0e_bceb_8a64f2fb0146.slice/crio-2383d0d93db3f1f6571e54c88bb3d360fb64646c165da8006c9ec246694754e3 WatchSource:0}: Error finding container 2383d0d93db3f1f6571e54c88bb3d360fb64646c165da8006c9ec246694754e3: Status 404 returned error can't find the container with id 2383d0d93db3f1f6571e54c88bb3d360fb64646c165da8006c9ec246694754e3 Jul 07 14:10:37.947132 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:37.947111 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtq62"] Jul 07 14:10:37.950598 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:37.950557 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12efb052_f435_486c_b580_fc65a24ac9a4.slice/crio-37336eff0432f56f74cd134965d2a3fad3b06c087903d4847486251887f61431 WatchSource:0}: Error finding container 37336eff0432f56f74cd134965d2a3fad3b06c087903d4847486251887f61431: Status 404 returned error can't find the container with id 37336eff0432f56f74cd134965d2a3fad3b06c087903d4847486251887f61431 Jul 07 14:10:38.021326 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.021296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:38.021701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.021392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:38.021701 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:38.021504 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:38.021701 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:38.021589 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls podName:162038fe-c332-4579-8404-6ba4f983382a nodeName:}" failed. No retries permitted until 2026-07-07 14:10:54.021555033 +0000 UTC m=+68.519164928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh9z5" (UID: "162038fe-c332-4579-8404-6ba4f983382a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:38.021818 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.021798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/162038fe-c332-4579-8404-6ba4f983382a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:38.149057 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.149032 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:38.241526 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.241423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" event={"ID":"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146","Type":"ContainerStarted","Data":"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0"} Jul 07 14:10:38.241526 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.241483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" event={"ID":"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146","Type":"ContainerStarted","Data":"2383d0d93db3f1f6571e54c88bb3d360fb64646c165da8006c9ec246694754e3"} Jul 07 14:10:38.241526 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.241512 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:10:38.242601 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.242561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtq62" event={"ID":"12efb052-f435-486c-b580-fc65a24ac9a4","Type":"ContainerStarted","Data":"37336eff0432f56f74cd134965d2a3fad3b06c087903d4847486251887f61431"} Jul 07 14:10:38.277994 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.277941 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" podStartSLOduration=24.277924274 podStartE2EDuration="24.277924274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:38.277511925 +0000 UTC m=+52.775121826" watchObservedRunningTime="2026-07-07 14:10:38.277924274 +0000 UTC m=+52.775534152" Jul 07 14:10:38.886070 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:38.886035 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:39.348560 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:39.348476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:39.550740 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:39.550707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:39.954910 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:39.954873 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:40.161776 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:40.161699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:40.374748 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:40.374672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:41.180629 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.180536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:41.252968 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.252937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtq62" event={"ID":"12efb052-f435-486c-b580-fc65a24ac9a4","Type":"ContainerStarted","Data":"adb84091b76a97d851b30660eefa5186852ef4a98bb675ee1873aedc3e0b197c"} Jul 07 14:10:41.253085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.253017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtq62" event={"ID":"12efb052-f435-486c-b580-fc65a24ac9a4","Type":"ContainerStarted","Data":"9fddaddfd6a6c574b7b878083f5bc82610f0d37fc097ff826dc70d5a22dd824d"} Jul 07 14:10:41.253085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.253072 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:41.372917 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.372890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:41.552658 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:41.552545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:44.874286 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:44.874251 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:44.951558 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:44.951530 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:48.185042 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:48.185016 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jd26" Jul 07 14:10:48.234796 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:48.234746 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wtq62" podStartSLOduration=24.550246611 podStartE2EDuration="27.234729822s" totalImagesPullingTime="2.684483211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:41.287670665 +0000 UTC m=+55.785280566" watchObservedRunningTime="2026-07-07 14:10:48.234729822 +0000 UTC m=+62.732339723" Jul 07 14:10:49.549297 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.549268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:49.790651 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.790620 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:49.952737 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.952683 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k"] Jul 07 14:10:49.955656 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.955637 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5"] Jul 07 14:10:49.955756 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.955729 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:49.957396 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.957379 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:49.969373 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.969350 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"networking-console-plugin-cert\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" Jul 07 14:10:49.969949 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.969924 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" Jul 07 14:10:49.970090 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.970074 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-dvzvn\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dvzvn\"" type="*v1.Secret" Jul 07 14:10:49.970264 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.970241 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"networking-console-plugin-6bffdf9778-wmw5k\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" podUID="1102d5e7-d6e9-43e7-889e-6127f544fa65" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:49.970393 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.970371 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"networking-console-plugin\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" Jul 07 14:10:49.970552 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.970527 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 07 14:10:49.970933 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.970913 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" Jul 07 14:10:49.971046 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.971025 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" Jul 07 14:10:49.971153 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.971136 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-ca\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" Jul 07 14:10:49.971310 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.971294 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-service-proxy-server-certificates\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" Jul 07 14:10:49.971514 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:49.971499 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-130-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 07 14:10:49.976850 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.976829 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k"] Jul 07 14:10:49.988372 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:49.988350 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5"] Jul 07 14:10:50.002526 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1102d5e7-d6e9-43e7-889e-6127f544fa65-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:50.002715 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1102d5e7-d6e9-43e7-889e-6127f544fa65-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:50.002715 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.002715 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.002890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4xt\" (UniqueName: \"kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.002890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.002890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.002890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.002875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.030004 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.029976 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:10:50.058510 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.058484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:50.103820 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.103983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4xt\" (UniqueName: \"kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.103983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.103983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.103983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.103983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.103948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1102d5e7-d6e9-43e7-889e-6127f544fa65-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:50.104197 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.104002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1102d5e7-d6e9-43e7-889e-6127f544fa65-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:50.104197 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.104065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.162817 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.162789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:50.284933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.284845 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:50.382658 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.382626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:50.523591 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.523549 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:50.849498 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.849472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dvzvn\"" Jul 07 14:10:50.891298 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.891272 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:10:50.921376 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.921352 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 14:10:50.926799 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.926778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.943220 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.943198 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 14:10:50.946325 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.946306 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:50.967957 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.967938 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 14:10:50.975510 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:50.975487 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1102d5e7-d6e9-43e7-889e-6127f544fa65-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:51.035096 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.035076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 14:10:51.046195 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.046176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1102d5e7-d6e9-43e7-889e-6127f544fa65-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wmw5k\" (UID: \"1102d5e7-d6e9-43e7-889e-6127f544fa65\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:51.104935 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104874 2560 configmap.go:193] Couldn't get configMap open-cluster-management-agent-addon/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 07 14:10:51.104935 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104898 2560 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/cluster-proxy-ca: failed to sync secret cache: timed out waiting for the condition Jul 07 14:10:51.104935 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104883 2560 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/cluster-proxy-service-proxy-server-certificates: failed to sync secret cache: timed out waiting for the condition Jul 07 14:10:51.105091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104940 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca podName:57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.604927483 +0000 UTC m=+66.102537362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "additional-service-ca" (UniqueName: "kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca") pod "cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" (UID: "57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3") : failed to sync configmap cache: timed out waiting for the condition Jul 07 14:10:51.105091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104975 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca podName:57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.604960885 +0000 UTC m=+66.102570764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ca" (UniqueName: "kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca") pod "cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" (UID: "57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3") : failed to sync secret cache: timed out waiting for the condition Jul 07 14:10:51.105091 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.104985 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert podName:57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.604979662 +0000 UTC m=+66.102589540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-proxy-server-cert" (UniqueName: "kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert") pod "cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" (UID: "57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3") : failed to sync secret cache: timed out waiting for the condition Jul 07 14:10:51.117168 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.117149 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 14:10:51.133258 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.133239 2560 projected.go:291] Couldn't get configMap open-cluster-management-agent-addon/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 07 14:10:51.165308 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.165289 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" Jul 07 14:10:51.208321 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.208296 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:10:51.213602 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.213534 2560 projected.go:196] Error preparing data for projected volume kube-api-access-2m4xt for pod open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5: failed to sync configmap cache: timed out waiting for the condition Jul 07 14:10:51.213742 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:10:51.213618 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt podName:57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:51.713600426 +0000 UTC m=+66.211210310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4xt" (UniqueName: "kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt") pod "cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" (UID: "57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3") : failed to sync configmap cache: timed out waiting for the condition Jul 07 14:10:51.258531 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.258509 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wtq62" Jul 07 14:10:51.299659 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.299632 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k"] Jul 07 14:10:51.302194 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:51.302172 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1102d5e7_d6e9_43e7_889e_6127f544fa65.slice/crio-a7ba2aa967ce5b0ec482d222beed74157304923e7cb8baa33c53897987b01297 WatchSource:0}: Error finding container a7ba2aa967ce5b0ec482d222beed74157304923e7cb8baa33c53897987b01297: Status 404 returned error can't find the container with id a7ba2aa967ce5b0ec482d222beed74157304923e7cb8baa33c53897987b01297 Jul 07 14:10:51.440495 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.440467 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:10:51.508770 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.508743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 14:10:51.616093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.616064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.616258 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.616111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:51.616258 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.616142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.616258 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.616175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.616902 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.616878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.618440 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.618417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-ca\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.618521 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.618469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.619228 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.619214 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:51.628567 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.628549 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ff2b42-e953-4f80-baf7-0848eabfa44e-metrics-certs\") pod \"network-metrics-daemon-d7svr\" (UID: \"02ff2b42-e953-4f80-baf7-0848eabfa44e\") " pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:51.708915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.708856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66bkv\"" Jul 07 14:10:51.716699 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.716680 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7svr" Jul 07 14:10:51.716902 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.716883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4xt\" (UniqueName: \"kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.716946 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.716930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:51.719380 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.719351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4xt\" (UniqueName: \"kubernetes.io/projected/57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3-kube-api-access-2m4xt\") pod \"cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5\" (UID: \"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.720480 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.720466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:51.729806 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.729781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/360feee3-2f22-467c-b806-d821d8065b6b-original-pull-secret\") pod \"global-pull-secret-syncer-zkpwv\" (UID: \"360feee3-2f22-467c-b806-d821d8065b6b\") " pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:51.785044 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.785008 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" Jul 07 14:10:51.818198 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.818166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:51.821828 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.821798 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:51.831190 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.831167 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:51.842848 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.842693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjcc\" (UniqueName: \"kubernetes.io/projected/151ee79c-f287-4642-91bf-b14d7e8ee46c-kube-api-access-pvjcc\") pod \"network-check-target-42d9m\" (UID: \"151ee79c-f287-4642-91bf-b14d7e8ee46c\") " pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:51.843863 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.843840 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7svr"] Jul 07 14:10:51.846971 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:51.846950 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ff2b42_e953_4f80_baf7_0848eabfa44e.slice/crio-66e7352a238fa2e1aa98b4001b75848ddc8824d63cc193d4e733d06e4def0cc9 WatchSource:0}: Error finding container 66e7352a238fa2e1aa98b4001b75848ddc8824d63cc193d4e733d06e4def0cc9: Status 404 returned error can't find the container with id 66e7352a238fa2e1aa98b4001b75848ddc8824d63cc193d4e733d06e4def0cc9 Jul 07 14:10:51.923691 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:51.923662 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5"] Jul 07 14:10:51.926723 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:51.926698 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57f6e7db_cd0c_4524_9e28_cdc1a43aa0c3.slice/crio-579dd296c77a4d3e48cdaf8c36f0156d15ff22f24bb79a6ecaf35bdf0e879f14 WatchSource:0}: Error finding container 579dd296c77a4d3e48cdaf8c36f0156d15ff22f24bb79a6ecaf35bdf0e879f14: Status 404 returned error can't find the container with id 579dd296c77a4d3e48cdaf8c36f0156d15ff22f24bb79a6ecaf35bdf0e879f14 Jul 07 14:10:52.016260 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.016189 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zlrf\"" Jul 07 14:10:52.018278 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.018253 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkpwv" Jul 07 14:10:52.023729 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.023710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:52.162144 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.162114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkpwv"] Jul 07 14:10:52.165370 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:52.165342 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360feee3_2f22_467c_b806_d821d8065b6b.slice/crio-ff0a458dbe14b5a83d7cb4649bac5359b78a5a4f07366a9cb75447cc9da3687b WatchSource:0}: Error finding container ff0a458dbe14b5a83d7cb4649bac5359b78a5a4f07366a9cb75447cc9da3687b: Status 404 returned error can't find the container with id ff0a458dbe14b5a83d7cb4649bac5359b78a5a4f07366a9cb75447cc9da3687b Jul 07 14:10:52.182913 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.182892 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42d9m"] Jul 07 14:10:52.186436 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:52.186412 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151ee79c_f287_4642_91bf_b14d7e8ee46c.slice/crio-9874058d961e2e65363235e2d377f67c4c0c29ad280304ee669a5c484ebc649a WatchSource:0}: Error finding container 9874058d961e2e65363235e2d377f67c4c0c29ad280304ee669a5c484ebc649a: Status 404 returned error can't find the container with id 9874058d961e2e65363235e2d377f67c4c0c29ad280304ee669a5c484ebc649a Jul 07 14:10:52.288869 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.288785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkpwv" event={"ID":"360feee3-2f22-467c-b806-d821d8065b6b","Type":"ContainerStarted","Data":"ff0a458dbe14b5a83d7cb4649bac5359b78a5a4f07366a9cb75447cc9da3687b"} Jul 07 14:10:52.290027 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.289999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" event={"ID":"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3","Type":"ContainerStarted","Data":"579dd296c77a4d3e48cdaf8c36f0156d15ff22f24bb79a6ecaf35bdf0e879f14"} Jul 07 14:10:52.291131 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.291107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" event={"ID":"1102d5e7-d6e9-43e7-889e-6127f544fa65","Type":"ContainerStarted","Data":"a7ba2aa967ce5b0ec482d222beed74157304923e7cb8baa33c53897987b01297"} Jul 07 14:10:52.292344 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.292319 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7svr" event={"ID":"02ff2b42-e953-4f80-baf7-0848eabfa44e","Type":"ContainerStarted","Data":"66e7352a238fa2e1aa98b4001b75848ddc8824d63cc193d4e733d06e4def0cc9"} Jul 07 14:10:52.293614 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:52.293586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42d9m" event={"ID":"151ee79c-f287-4642-91bf-b14d7e8ee46c","Type":"ContainerStarted","Data":"9874058d961e2e65363235e2d377f67c4c0c29ad280304ee669a5c484ebc649a"} Jul 07 14:10:53.302470 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.302429 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" event={"ID":"1102d5e7-d6e9-43e7-889e-6127f544fa65","Type":"ContainerStarted","Data":"1086339c6abd8679c0d5d3a8e7488e173c9c13c81971ba72605280f74d11c7b7"} Jul 07 14:10:53.324590 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.322677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wmw5k" podStartSLOduration=3.042195879 podStartE2EDuration="4.322653911s" totalImagesPullingTime="1.280458032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:53.321701402 +0000 UTC m=+67.819311304" watchObservedRunningTime="2026-07-07 14:10:53.322653911 +0000 UTC m=+67.820263813" Jul 07 14:10:53.462407 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.462359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:53.563636 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.563546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:53.681242 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.681152 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:53.779599 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.779514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:53.874240 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:53.874137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:54.000932 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.000900 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:54.036479 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.036414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:54.042042 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.041843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/162038fe-c332-4579-8404-6ba4f983382a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh9z5\" (UID: \"162038fe-c332-4579-8404-6ba4f983382a\") " pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:54.209670 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.209565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:54.304583 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.304495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhpqs\"" Jul 07 14:10:54.308679 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:54.308658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh9z5" Jul 07 14:10:55.087550 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:55.087518 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh9z5"] Jul 07 14:10:55.314269 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:55.314137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7svr" event={"ID":"02ff2b42-e953-4f80-baf7-0848eabfa44e","Type":"ContainerStarted","Data":"c31ec7e76dbcc30cee6d70b2ac576f351a6b6c2e286bee2835fcbcd74ec8b46b"} Jul 07 14:10:56.071833 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:10:56.071595 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162038fe_c332_4579_8404_6ba4f983382a.slice/crio-27bceeb4bf162f1447f69663d3ff6cef518119ee0f58f986b68884f50d894e09 WatchSource:0}: Error finding container 27bceeb4bf162f1447f69663d3ff6cef518119ee0f58f986b68884f50d894e09: Status 404 returned error can't find the container with id 27bceeb4bf162f1447f69663d3ff6cef518119ee0f58f986b68884f50d894e09 Jul 07 14:10:56.318335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:56.318294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh9z5" event={"ID":"162038fe-c332-4579-8404-6ba4f983382a","Type":"ContainerStarted","Data":"27bceeb4bf162f1447f69663d3ff6cef518119ee0f58f986b68884f50d894e09"} Jul 07 14:10:58.431458 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:58.431423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:59.329778 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.329669 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42d9m" event={"ID":"151ee79c-f287-4642-91bf-b14d7e8ee46c","Type":"ContainerStarted","Data":"ef9e5ed53fb5526ae8bd38c7e46c6a62a01533ea139876aae7da1d4d5aa74ee5"} Jul 07 14:10:59.329778 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.329747 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:10:59.331429 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.331399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkpwv" event={"ID":"360feee3-2f22-467c-b806-d821d8065b6b","Type":"ContainerStarted","Data":"40b1305130d5f2c3d7b9d35be18a9c4555deb4a987f7e86f7525678bc375468f"} Jul 07 14:10:59.333780 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.333751 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" event={"ID":"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3","Type":"ContainerStarted","Data":"74b731e6919bddfb5a3938ac4f4cf9ff94f72598a78e5f27c6a9d607f77cfad3"} Jul 07 14:10:59.333916 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.333799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" event={"ID":"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3","Type":"ContainerStarted","Data":"14c86e405e417bbef1cfbd57450f1f7de1052ab6e7542cc08dd11d9ad18ae395"} Jul 07 14:10:59.333916 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.333819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" event={"ID":"57f6e7db-cd0c-4524-9e28-cdc1a43aa0c3","Type":"ContainerStarted","Data":"1722d1c8f89a0f2bf5e43194cd91dcd827c3404bc69dd2696dc55241a116124b"} Jul 07 14:10:59.335965 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.335943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7svr" event={"ID":"02ff2b42-e953-4f80-baf7-0848eabfa44e","Type":"ContainerStarted","Data":"957296c0c13b7ff7cb3b8dd478961a50adfa52f709065baeea4a560b0e911766"} Jul 07 14:10:59.352284 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.352238 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-42d9m" podStartSLOduration=66.930175669 podStartE2EDuration="1m13.352220677s" totalImagesPullingTime="6.422045008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:59.351668736 +0000 UTC m=+73.849278638" watchObservedRunningTime="2026-07-07 14:10:59.352220677 +0000 UTC m=+73.849830579" Jul 07 14:10:59.380907 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.380767 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f7fcdb8c8-wbvr5" podStartSLOduration=3.6812048429999997 podStartE2EDuration="10.380748908s" totalImagesPullingTime="6.699544065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:59.378827872 +0000 UTC m=+73.876437785" watchObservedRunningTime="2026-07-07 14:10:59.380748908 +0000 UTC m=+73.878358808" Jul 07 14:10:59.401009 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.400961 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zkpwv" podStartSLOduration=66.942360127 podStartE2EDuration="1m13.40094523s" totalImagesPullingTime="6.458585103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:59.399731443 +0000 UTC m=+73.897341345" watchObservedRunningTime="2026-07-07 14:10:59.40094523 +0000 UTC m=+73.898555131" Jul 07 14:10:59.423731 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.423693 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d7svr" podStartSLOduration=70.353376387 podStartE2EDuration="1m13.423681361s" totalImagesPullingTime="3.070304974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:59.422210664 +0000 UTC m=+73.919820565" watchObservedRunningTime="2026-07-07 14:10:59.423681361 +0000 UTC m=+73.921291262" Jul 07 14:10:59.557621 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.557587 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:59.629436 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.629409 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:59.847086 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.847048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:59.961284 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:10:59.961185 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:00.035933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.035905 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:11:00.065704 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.065668 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:00.174868 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.174836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:00.514460 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.514402 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:00.620603 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.620554 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jzrtb"] Jul 07 14:11:00.643743 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.643709 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:00.707789 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.707754 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.719943 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.719912 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:11:00.720306 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.720285 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:11:00.721280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.721247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:11:00.721368 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.721339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:11:00.721486 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.721468 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:11:00.721617 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.721517 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:11:00.721700 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.721256 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cf95v\"" Jul 07 14:11:00.794093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.793986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-root\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794317 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-wtmp\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794317 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-sys\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794317 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-metrics-client-ca\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794317 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794317 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rqv8\" (UniqueName: \"kubernetes.io/projected/03f12692-c80b-4ff6-89f4-1f5906e6e456-kube-api-access-2rqv8\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794542 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-textfile\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.794542 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.794369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-tls\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.895767 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-metrics-client-ca\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.895767 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.895767 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rqv8\" (UniqueName: \"kubernetes.io/projected/03f12692-c80b-4ff6-89f4-1f5906e6e456-kube-api-access-2rqv8\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-textfile\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-tls\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-root\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-wtmp\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.895944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-sys\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896111 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-sys\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896454 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-root\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896454 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-metrics-client-ca\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896564 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-textfile\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896564 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-wtmp\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.896725 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.896703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.899103 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.898763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.899103 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.899059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03f12692-c80b-4ff6-89f4-1f5906e6e456-node-exporter-tls\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:00.911554 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:00.911526 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rqv8\" (UniqueName: \"kubernetes.io/projected/03f12692-c80b-4ff6-89f4-1f5906e6e456-kube-api-access-2rqv8\") pod \"node-exporter-jzrtb\" (UID: \"03f12692-c80b-4ff6-89f4-1f5906e6e456\") " pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:01.021953 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.021902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzrtb" Jul 07 14:11:01.071946 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.071875 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:01.171893 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.171862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:01.449810 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.449776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:01.566326 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.566288 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:01.699039 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.699005 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:01.811256 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:01.811182 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:02.836879 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:11:02.836834 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f12692_c80b_4ff6_89f4_1f5906e6e456.slice/crio-710a3a826be29e7697226eca3e892dd12078bf345195b0e0e8054b20b7f7bd15 WatchSource:0}: Error finding container 710a3a826be29e7697226eca3e892dd12078bf345195b0e0e8054b20b7f7bd15: Status 404 returned error can't find the container with id 710a3a826be29e7697226eca3e892dd12078bf345195b0e0e8054b20b7f7bd15 Jul 07 14:11:03.353194 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:03.353143 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzrtb" event={"ID":"03f12692-c80b-4ff6-89f4-1f5906e6e456","Type":"ContainerStarted","Data":"710a3a826be29e7697226eca3e892dd12078bf345195b0e0e8054b20b7f7bd15"} Jul 07 14:11:03.354848 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:03.354817 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh9z5" event={"ID":"162038fe-c332-4579-8404-6ba4f983382a","Type":"ContainerStarted","Data":"e55d26de8ca59ed491bdf016eed8d939a4fa8ae873b5e91bb536f764bc3cb56a"} Jul 07 14:11:04.116959 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.116870 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:04.304689 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.304655 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:04.359349 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.359321 2560 generic.go:356] "Generic (PLEG): container finished" podID="03f12692-c80b-4ff6-89f4-1f5906e6e456" containerID="0c13d16080d3203e07560eb3d0ed6963eff3086e097e98c81f3769e775ff4c6a" exitCode=0 Jul 07 14:11:04.359485 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.359392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzrtb" event={"ID":"03f12692-c80b-4ff6-89f4-1f5906e6e456","Type":"ContainerDied","Data":"0c13d16080d3203e07560eb3d0ed6963eff3086e097e98c81f3769e775ff4c6a"} Jul 07 14:11:04.460509 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.460486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:04.604484 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:04.604449 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:05.221841 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.221813 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:05.366278 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.366232 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzrtb" event={"ID":"03f12692-c80b-4ff6-89f4-1f5906e6e456","Type":"ContainerStarted","Data":"17524b045e301a5207f927ef96b33ae8cb51a1011f5e6e58c07925d29416e223"} Jul 07 14:11:05.366441 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.366297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzrtb" event={"ID":"03f12692-c80b-4ff6-89f4-1f5906e6e456","Type":"ContainerStarted","Data":"10dd1753d0eb1b6387437e431d85db75f99b174c8da972f6bc55c466f0fd9817"} Jul 07 14:11:05.368373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.368342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh9z5" event={"ID":"162038fe-c332-4579-8404-6ba4f983382a","Type":"ContainerStarted","Data":"a933478cb6062e0d5c2865e54ca3d68e99f33cdf5a8a7e97943213ed3cac047a"} Jul 07 14:11:05.405680 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.405627 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jzrtb" podStartSLOduration=4.470631645 podStartE2EDuration="5.405608507s" totalImagesPullingTime="872.526567ms" totalInitContainerRuntime="62.450295ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:05.404170639 +0000 UTC m=+79.901780555" watchObservedRunningTime="2026-07-07 14:11:05.405608507 +0000 UTC m=+79.903218409" Jul 07 14:11:05.530873 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:05.530790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:07.383464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:07.383439 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:07.621596 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:07.621499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:07.743722 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:07.743695 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:08.048275 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:08.048165 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:08.384269 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:08.384237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh9z5" event={"ID":"162038fe-c332-4579-8404-6ba4f983382a","Type":"ContainerStarted","Data":"bc485d7ef3df01c2184f129ff5ae6152bce2365599e4ca1702fd5cf9863c6b88"} Jul 07 14:11:08.390618 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:08.390593 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:08.491799 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:08.491779 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:08.701607 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:08.701513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:09.230441 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:09.230408 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:09.406173 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:09.406137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:10.548411 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.548246 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kh9z5" podStartSLOduration=37.467073442 podStartE2EDuration="48.548227108s" totalImagesPullingTime="11.081153666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:08.452264307 +0000 UTC m=+82.949874208" watchObservedRunningTime="2026-07-07 14:11:10.548227108 +0000 UTC m=+85.045837009" Jul 07 14:11:10.549175 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.549160 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:10.554372 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.554347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.557563 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.557541 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:11:10.558688 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.558656 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:11:10.558801 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.558699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:11:10.558801 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.558724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:11:10.558919 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.558799 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:11:10.559017 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.559000 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:11:10.559069 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.559000 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:11:10.559069 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.559052 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zwp6d\"" Jul 07 14:11:10.576728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.576707 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:10.670692 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.670692 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.670859 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.670859 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.670859 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq878\" (UniqueName: \"kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.670859 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.670817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771701 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq878\" (UniqueName: \"kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771803 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771803 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771764 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771803 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771917 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.771979 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.771961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.772502 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.772478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.772502 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.772496 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.772681 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.772595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.774235 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.774207 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.774335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.774295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.782401 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.782381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq878\" (UniqueName: \"kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878\") pod \"console-6c448b7b7c-tsz4c\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:10.863472 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:10.863421 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:11.015558 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:11.015525 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:11.019675 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:11:11.019640 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c10ede_62fb_4c18_930b_14d94ea5793f.slice/crio-471c399c59b4ee1dc29316d38a9ac0490f0d1ff35f0524c12d4e12c5152a0178 WatchSource:0}: Error finding container 471c399c59b4ee1dc29316d38a9ac0490f0d1ff35f0524c12d4e12c5152a0178: Status 404 returned error can't find the container with id 471c399c59b4ee1dc29316d38a9ac0490f0d1ff35f0524c12d4e12c5152a0178 Jul 07 14:11:11.398050 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:11.398016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c448b7b7c-tsz4c" event={"ID":"53c10ede-62fb-4c18-930b-14d94ea5793f","Type":"ContainerStarted","Data":"471c399c59b4ee1dc29316d38a9ac0490f0d1ff35f0524c12d4e12c5152a0178"} Jul 07 14:11:12.045091 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:12.045042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:12.123077 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:12.123042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:13.886742 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:13.886704 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:14.022942 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:14.022909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:14.409338 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:14.409307 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c448b7b7c-tsz4c" event={"ID":"53c10ede-62fb-4c18-930b-14d94ea5793f","Type":"ContainerStarted","Data":"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7"} Jul 07 14:11:14.887191 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:14.887161 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:14.977170 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:14.977145 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:15.048956 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.048927 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" podUID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" containerName="registry" containerID="cri-o://e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0" gracePeriod=30 Jul 07 14:11:15.288436 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.288415 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:11:15.322610 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.322047 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c448b7b7c-tsz4c" podStartSLOduration=2.128353598 podStartE2EDuration="5.322025809s" totalImagesPullingTime="3.193672211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:14.440702291 +0000 UTC m=+88.938312192" watchObservedRunningTime="2026-07-07 14:11:15.322025809 +0000 UTC m=+89.819635703" Jul 07 14:11:15.404768 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404742 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.404903 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404779 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.404903 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404803 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.404903 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404830 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t55rr\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.404903 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404885 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.405090 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404927 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.405090 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404964 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.405090 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.404993 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token\") pod \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\" (UID: \"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146\") " Jul 07 14:11:15.405242 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.405189 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:15.405484 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.405455 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:15.407420 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.407397 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr" (OuterVolumeSpecName: "kube-api-access-t55rr") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "kube-api-access-t55rr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:15.407599 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.407452 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:15.407787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.407762 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:15.407787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.407774 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:15.408060 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.408029 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:15.420122 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.420064 2560 generic.go:356] "Generic (PLEG): container finished" podID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" containerID="e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0" exitCode=0 Jul 07 14:11:15.420206 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.420123 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" Jul 07 14:11:15.420206 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.420142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" event={"ID":"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146","Type":"ContainerDied","Data":"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0"} Jul 07 14:11:15.420272 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.420221 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5694b5c4b8-sf5dg" event={"ID":"d962e74f-0cb3-4f0e-bceb-8a64f2fb0146","Type":"ContainerDied","Data":"2383d0d93db3f1f6571e54c88bb3d360fb64646c165da8006c9ec246694754e3"} Jul 07 14:11:15.420272 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.420247 2560 scope.go:117] "RemoveContainer" containerID="e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0" Jul 07 14:11:15.421859 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.421840 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" (UID: "d962e74f-0cb3-4f0e-bceb-8a64f2fb0146"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:11:15.427930 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.427900 2560 scope.go:117] "RemoveContainer" containerID="e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0" Jul 07 14:11:15.428164 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:11:15.428144 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0\": container with ID starting with e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0 not found: ID does not exist" containerID="e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0" Jul 07 14:11:15.428208 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.428174 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0"} err="failed to get container status \"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0\": rpc error: code = NotFound desc = could not find container \"e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0\": container with ID starting with e5d214ed98db1ecd477c34cad74920bb2a2423bf8d78863ca87324cf592e94a0 not found: ID does not exist" Jul 07 14:11:15.506188 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506159 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-ca-trust-extracted\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506188 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506186 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55rr\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-kube-api-access-t55rr\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506202 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-image-registry-private-configuration\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506216 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-installation-pull-secrets\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506229 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-trusted-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506241 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-bound-sa-token\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506254 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.506331 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.506267 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146-registry-certificates\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:15.764387 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.764362 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:11:15.771965 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.771942 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5694b5c4b8-sf5dg"] Jul 07 14:11:15.998503 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:15.998431 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" path="/var/lib/kubelet/pods/d962e74f-0cb3-4f0e-bceb-8a64f2fb0146/volumes" Jul 07 14:11:16.067909 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:16.067880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:16.320443 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:16.320377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:16.448633 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:16.448600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:18.354887 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:18.354853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:18.508869 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:18.508833 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:18.744058 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:18.744027 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:18.873491 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:18.873456 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:20.362122 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.362090 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:11:20.362467 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.362318 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" containerName="registry" Jul 07 14:11:20.362467 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.362328 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" containerName="registry" Jul 07 14:11:20.362467 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.362369 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d962e74f-0cb3-4f0e-bceb-8a64f2fb0146" containerName="registry" Jul 07 14:11:20.367174 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.367154 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.392080 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.392058 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:11:20.398997 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.398976 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:11:20.439529 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjmm\" (UniqueName: \"kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439630 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439630 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439708 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439708 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439708 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.439708 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.439701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.540807 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjmm\" (UniqueName: \"kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.540918 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.540918 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.540918 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541073 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541073 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.540979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541073 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.541004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541748 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.541722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.541784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.541856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.541840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.542019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.541925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.543417 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.543395 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.543493 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.543427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.554584 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.554558 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjmm\" (UniqueName: \"kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm\") pod \"console-f959c7ff9-7v77f\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.675710 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.675684 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:20.846056 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.846032 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:11:20.848273 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:11:20.848242 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e2f986_3ab8_41b7_bf36_335b0bb5c439.slice/crio-42ff8c20404cae73b97271b0410ff04feee8451c75a75d318ee8ddaa58db1603 WatchSource:0}: Error finding container 42ff8c20404cae73b97271b0410ff04feee8451c75a75d318ee8ddaa58db1603: Status 404 returned error can't find the container with id 42ff8c20404cae73b97271b0410ff04feee8451c75a75d318ee8ddaa58db1603 Jul 07 14:11:20.864092 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.864064 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:20.864192 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.864129 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:20.869459 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:20.869441 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:21.443009 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:21.442972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f959c7ff9-7v77f" event={"ID":"a5e2f986-3ab8-41b7-bf36-335b0bb5c439","Type":"ContainerStarted","Data":"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705"} Jul 07 14:11:21.443367 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:21.443049 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f959c7ff9-7v77f" event={"ID":"a5e2f986-3ab8-41b7-bf36-335b0bb5c439","Type":"ContainerStarted","Data":"42ff8c20404cae73b97271b0410ff04feee8451c75a75d318ee8ddaa58db1603"} Jul 07 14:11:21.446981 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:21.446956 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:21.523412 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:21.523369 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f959c7ff9-7v77f" podStartSLOduration=1.523355883 podStartE2EDuration="1.523355883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:21.503554116 +0000 UTC m=+96.001164017" watchObservedRunningTime="2026-07-07 14:11:21.523355883 +0000 UTC m=+96.020965783" Jul 07 14:11:22.559187 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:22.559158 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:22.797836 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:22.797802 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:22.957383 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:22.957348 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:23.647797 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:23.647769 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:23.756604 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:23.756552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:25.229175 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:25.229143 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:25.297283 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:25.297254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:27.186550 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:27.186519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:27.290814 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:27.290791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:27.441343 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:27.441275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:28.973288 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:28.973248 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:29.102085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:29.102057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:29.873182 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:29.873149 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:29.973966 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:29.973937 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:30.341921 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:30.341889 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-42d9m" Jul 07 14:11:30.676632 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:30.676600 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:30.676789 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:30.676674 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:30.681406 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:30.681385 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:31.482077 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:31.482050 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:11:31.591981 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:31.591940 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:35.331238 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:35.331208 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:44.868022 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:44.867990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:44.930811 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:44.930787 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:51.529493 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:51.529457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:56.611424 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.611361 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c448b7b7c-tsz4c" podUID="53c10ede-62fb-4c18-930b-14d94ea5793f" containerName="console" containerID="cri-o://a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7" gracePeriod=15 Jul 07 14:11:56.855444 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.855418 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:56.898880 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.898852 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.898893 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq878\" (UniqueName: \"kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.898935 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.898970 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.898997 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899216 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.899018 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca\") pod \"53c10ede-62fb-4c18-930b-14d94ea5793f\" (UID: \"53c10ede-62fb-4c18-930b-14d94ea5793f\") " Jul 07 14:11:56.899321 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.899294 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config" (OuterVolumeSpecName: "console-config") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:56.899441 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.899416 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:56.899502 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.899481 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca" (OuterVolumeSpecName: "service-ca") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:56.901257 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.901230 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:56.901359 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.901251 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:56.901359 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.901282 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878" (OuterVolumeSpecName: "kube-api-access-xq878") pod "53c10ede-62fb-4c18-930b-14d94ea5793f" (UID: "53c10ede-62fb-4c18-930b-14d94ea5793f"). InnerVolumeSpecName "kube-api-access-xq878". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:56.999720 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999690 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq878\" (UniqueName: \"kubernetes.io/projected/53c10ede-62fb-4c18-930b-14d94ea5793f-kube-api-access-xq878\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:56.999720 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999718 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:56.999874 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999729 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-oauth-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:56.999874 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999737 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c10ede-62fb-4c18-930b-14d94ea5793f-console-oauth-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:56.999874 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999746 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:56.999874 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:56.999754 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c10ede-62fb-4c18-930b-14d94ea5793f-console-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:11:57.565514 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.565476 2560 generic.go:356] "Generic (PLEG): container finished" podID="53c10ede-62fb-4c18-930b-14d94ea5793f" containerID="a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7" exitCode=0 Jul 07 14:11:57.565755 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.565519 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c448b7b7c-tsz4c" Jul 07 14:11:57.565755 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.565550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c448b7b7c-tsz4c" event={"ID":"53c10ede-62fb-4c18-930b-14d94ea5793f","Type":"ContainerDied","Data":"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7"} Jul 07 14:11:57.565755 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.565619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c448b7b7c-tsz4c" event={"ID":"53c10ede-62fb-4c18-930b-14d94ea5793f","Type":"ContainerDied","Data":"471c399c59b4ee1dc29316d38a9ac0490f0d1ff35f0524c12d4e12c5152a0178"} Jul 07 14:11:57.565755 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.565646 2560 scope.go:117] "RemoveContainer" containerID="a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7" Jul 07 14:11:57.574198 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.574179 2560 scope.go:117] "RemoveContainer" containerID="a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7" Jul 07 14:11:57.574437 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:11:57.574416 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7\": container with ID starting with a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7 not found: ID does not exist" containerID="a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7" Jul 07 14:11:57.574487 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.574445 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7"} err="failed to get container status \"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7\": rpc error: code = NotFound desc = could not find container \"a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7\": container with ID starting with a0ab974668136ac13117b54df04b78bf013de53ed582ac32449f5199f1c7eab7 not found: ID does not exist" Jul 07 14:11:57.590740 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.590719 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:57.600588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.600550 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c448b7b7c-tsz4c"] Jul 07 14:11:57.998107 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:11:57.998075 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c10ede-62fb-4c18-930b-14d94ea5793f" path="/var/lib/kubelet/pods/53c10ede-62fb-4c18-930b-14d94ea5793f/volumes" Jul 07 14:12:04.969646 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:04.969617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:05.033023 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:05.032987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:20.522010 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:20.521972 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:21.262993 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:21.262957 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:30.193362 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.193329 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:12:30.193823 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.193582 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c10ede-62fb-4c18-930b-14d94ea5793f" containerName="console" Jul 07 14:12:30.193823 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.193594 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c10ede-62fb-4c18-930b-14d94ea5793f" containerName="console" Jul 07 14:12:30.193823 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.193648 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="53c10ede-62fb-4c18-930b-14d94ea5793f" containerName="console" Jul 07 14:12:30.196543 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.196528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.206653 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.206628 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:12:30.247534 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.247506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:30.323646 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323646 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323824 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323824 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323685 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323824 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323824 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8ns\" (UniqueName: \"kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.323967 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.323836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424208 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424208 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424413 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424413 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424413 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424534 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8ns\" (UniqueName: \"kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424534 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.424978 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.424947 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.425218 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.425195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.425265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.425220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.425265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.425195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.426822 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.426793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.426910 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.426847 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.435588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.435545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8ns\" (UniqueName: \"kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns\") pod \"console-55f9f6b85b-894ln\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.506276 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.506200 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:30.635674 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.635644 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:12:30.639098 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:12:30.639067 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2ccdf5_0bf0_42ed_8d62_8d811e876865.slice/crio-c41faabd1f18c338ac9ee5df32d0b423a1a9b085faa6058170479f7ec7d23525 WatchSource:0}: Error finding container c41faabd1f18c338ac9ee5df32d0b423a1a9b085faa6058170479f7ec7d23525: Status 404 returned error can't find the container with id c41faabd1f18c338ac9ee5df32d0b423a1a9b085faa6058170479f7ec7d23525 Jul 07 14:12:30.676880 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:30.676846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f9f6b85b-894ln" event={"ID":"9b2ccdf5-0bf0-42ed-8d62-8d811e876865","Type":"ContainerStarted","Data":"c41faabd1f18c338ac9ee5df32d0b423a1a9b085faa6058170479f7ec7d23525"} Jul 07 14:12:31.681507 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:31.681469 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f9f6b85b-894ln" event={"ID":"9b2ccdf5-0bf0-42ed-8d62-8d811e876865","Type":"ContainerStarted","Data":"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59"} Jul 07 14:12:31.710954 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:31.710905 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f9f6b85b-894ln" podStartSLOduration=1.710886934 podStartE2EDuration="1.710886934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:31.709250371 +0000 UTC m=+166.206860272" watchObservedRunningTime="2026-07-07 14:12:31.710886934 +0000 UTC m=+166.208496835" Jul 07 14:12:40.507259 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.507173 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:40.507259 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.507232 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:40.511966 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.511943 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:40.715521 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.715497 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:12:40.767337 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.767262 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:12:40.880440 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.880411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:40.944426 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:40.944403 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:12:41.005659 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:12:41.005636 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:05.786466 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:05.786426 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f959c7ff9-7v77f" podUID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" containerName="console" containerID="cri-o://67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705" gracePeriod=15 Jul 07 14:13:06.033964 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.033922 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:13:06.175927 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.175899 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176084 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.175933 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176084 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.175981 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176084 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176023 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176084 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176068 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176297 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176093 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176297 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176122 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcjmm\" (UniqueName: \"kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm\") pod \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\" (UID: \"a5e2f986-3ab8-41b7-bf36-335b0bb5c439\") " Jul 07 14:13:06.176474 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176382 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:06.176639 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176606 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:06.176867 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176832 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:06.176956 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.176868 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config" (OuterVolumeSpecName: "console-config") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:06.178197 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.178167 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:13:06.178439 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.178407 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm" (OuterVolumeSpecName: "kube-api-access-zcjmm") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "kube-api-access-zcjmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:13:06.178524 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.178487 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5e2f986-3ab8-41b7-bf36-335b0bb5c439" (UID: "a5e2f986-3ab8-41b7-bf36-335b0bb5c439"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:13:06.276950 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276917 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-oauth-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.276950 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276943 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.276950 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276953 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcjmm\" (UniqueName: \"kubernetes.io/projected/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-kube-api-access-zcjmm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.277167 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276964 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.277167 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276973 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-console-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.277167 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276981 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-oauth-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.277167 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.276989 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e2f986-3ab8-41b7-bf36-335b0bb5c439-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:13:06.796543 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.796501 2560 generic.go:356] "Generic (PLEG): container finished" podID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" containerID="67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705" exitCode=0 Jul 07 14:13:06.796933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.796562 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f959c7ff9-7v77f" Jul 07 14:13:06.796933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.796604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f959c7ff9-7v77f" event={"ID":"a5e2f986-3ab8-41b7-bf36-335b0bb5c439","Type":"ContainerDied","Data":"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705"} Jul 07 14:13:06.796933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.796662 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f959c7ff9-7v77f" event={"ID":"a5e2f986-3ab8-41b7-bf36-335b0bb5c439","Type":"ContainerDied","Data":"42ff8c20404cae73b97271b0410ff04feee8451c75a75d318ee8ddaa58db1603"} Jul 07 14:13:06.796933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.796693 2560 scope.go:117] "RemoveContainer" containerID="67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705" Jul 07 14:13:06.804821 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.804802 2560 scope.go:117] "RemoveContainer" containerID="67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705" Jul 07 14:13:06.805100 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:13:06.805081 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705\": container with ID starting with 67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705 not found: ID does not exist" containerID="67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705" Jul 07 14:13:06.805147 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.805108 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705"} err="failed to get container status \"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705\": rpc error: code = NotFound desc = could not find container \"67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705\": container with ID starting with 67fb93eabf0688024f5738f7f1e89fe5b3892226d1d366610533ae0dc7072705 not found: ID does not exist" Jul 07 14:13:06.818931 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.818907 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:13:06.824816 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:06.824794 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f959c7ff9-7v77f"] Jul 07 14:13:07.998866 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:07.998833 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" path="/var/lib/kubelet/pods/a5e2f986-3ab8-41b7-bf36-335b0bb5c439/volumes" Jul 07 14:13:12.937885 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:12.937848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:35.833194 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:35.833163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:35.931994 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:35.931964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:47.892396 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:47.892365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:47.995195 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:47.995165 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:59.888967 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:59.888930 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:59.989452 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:13:59.989410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:00.053951 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:00.053919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:07.173503 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.173467 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:14:07.173899 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.173725 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" containerName="console" Jul 07 14:14:07.173899 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.173738 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" containerName="console" Jul 07 14:14:07.173899 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.173779 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e2f986-3ab8-41b7-bf36-335b0bb5c439" containerName="console" Jul 07 14:14:07.177640 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.177621 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.186339 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.186314 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:14:07.272224 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272373 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.272535 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.272385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjsw\" (UniqueName: \"kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.284831 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.284795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:07.373236 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373315 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjsw\" (UniqueName: \"kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373462 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373462 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373378 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.373554 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.373503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.374052 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.374025 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.374165 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.374084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.374321 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.374300 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.374385 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.374340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.375743 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.375723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.375868 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.375846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.387996 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.387970 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjsw\" (UniqueName: \"kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw\") pod \"console-5f759658dc-mkzn9\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.408369 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.408347 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:07.488222 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.488169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:07.613883 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.613849 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:14:07.618241 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:14:07.618216 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964fd1cd_a51a_47fc_bfe6_1400d0c390d0.slice/crio-9575b9ca9903f16380ca29055b87b02823de5e975bd5af8bc766ee132cd9f83d WatchSource:0}: Error finding container 9575b9ca9903f16380ca29055b87b02823de5e975bd5af8bc766ee132cd9f83d: Status 404 returned error can't find the container with id 9575b9ca9903f16380ca29055b87b02823de5e975bd5af8bc766ee132cd9f83d Jul 07 14:14:07.998732 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.998653 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f759658dc-mkzn9" event={"ID":"964fd1cd-a51a-47fc-bfe6-1400d0c390d0","Type":"ContainerStarted","Data":"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc"} Jul 07 14:14:07.998732 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:07.998702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f759658dc-mkzn9" event={"ID":"964fd1cd-a51a-47fc-bfe6-1400d0c390d0","Type":"ContainerStarted","Data":"9575b9ca9903f16380ca29055b87b02823de5e975bd5af8bc766ee132cd9f83d"} Jul 07 14:14:08.019639 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:08.019595 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f759658dc-mkzn9" podStartSLOduration=1.019563529 podStartE2EDuration="1.019563529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:08.018192865 +0000 UTC m=+262.515802766" watchObservedRunningTime="2026-07-07 14:14:08.019563529 +0000 UTC m=+262.517173430" Jul 07 14:14:13.638765 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:13.638726 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:17.488557 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:17.488503 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:17.489043 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:17.488634 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:17.493295 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:17.493274 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:18.032478 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:18.032448 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:14:18.091198 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:18.091171 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:14:18.200209 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:18.200176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:18.272240 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:18.272204 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:18.332060 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:18.331996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:22.200241 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:22.200203 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:43.110869 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.110830 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55f9f6b85b-894ln" podUID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" containerName="console" containerID="cri-o://ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59" gracePeriod=15 Jul 07 14:14:43.355487 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.355463 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:14:43.539753 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539724 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539757 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt8ns\" (UniqueName: \"kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539784 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539826 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539845 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539866 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.539915 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.539900 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle\") pod \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\" (UID: \"9b2ccdf5-0bf0-42ed-8d62-8d811e876865\") " Jul 07 14:14:43.540289 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.540258 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:43.540350 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.540263 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config" (OuterVolumeSpecName: "console-config") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:43.540350 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.540331 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:43.540417 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.540390 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:43.542199 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.542170 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns" (OuterVolumeSpecName: "kube-api-access-mt8ns") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "kube-api-access-mt8ns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:14:43.542199 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.542173 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:43.542351 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.542228 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b2ccdf5-0bf0-42ed-8d62-8d811e876865" (UID: "9b2ccdf5-0bf0-42ed-8d62-8d811e876865"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:43.641305 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641281 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-oauth-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641305 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641301 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641311 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641320 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt8ns\" (UniqueName: \"kubernetes.io/projected/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-kube-api-access-mt8ns\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641329 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-oauth-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641337 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-console-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:43.641464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:43.641345 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b2ccdf5-0bf0-42ed-8d62-8d811e876865-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:14:44.112137 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.112102 2560 generic.go:356] "Generic (PLEG): container finished" podID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" containerID="ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59" exitCode=0 Jul 07 14:14:44.112488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.112154 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f9f6b85b-894ln" Jul 07 14:14:44.112488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.112163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f9f6b85b-894ln" event={"ID":"9b2ccdf5-0bf0-42ed-8d62-8d811e876865","Type":"ContainerDied","Data":"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59"} Jul 07 14:14:44.112488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.112210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f9f6b85b-894ln" event={"ID":"9b2ccdf5-0bf0-42ed-8d62-8d811e876865","Type":"ContainerDied","Data":"c41faabd1f18c338ac9ee5df32d0b423a1a9b085faa6058170479f7ec7d23525"} Jul 07 14:14:44.112488 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.112231 2560 scope.go:117] "RemoveContainer" containerID="ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59" Jul 07 14:14:44.119818 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.119799 2560 scope.go:117] "RemoveContainer" containerID="ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59" Jul 07 14:14:44.120077 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:14:44.120057 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59\": container with ID starting with ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59 not found: ID does not exist" containerID="ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59" Jul 07 14:14:44.120129 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.120087 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59"} err="failed to get container status \"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59\": rpc error: code = NotFound desc = could not find container \"ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59\": container with ID starting with ffb41b12674dc59c35d4aba279830dc95c84e050b210d2e62ab78753b8d3bf59 not found: ID does not exist" Jul 07 14:14:44.131445 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.131422 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:14:44.136794 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:44.136774 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f9f6b85b-894ln"] Jul 07 14:14:45.819666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:45.819641 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:14:45.997962 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:45.997932 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" path="/var/lib/kubelet/pods/9b2ccdf5-0bf0-42ed-8d62-8d811e876865/volumes" Jul 07 14:14:52.515661 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:52.515629 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:53.748165 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.748128 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:53.986966 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.986933 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb"] Jul 07 14:14:53.987179 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.987168 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" containerName="console" Jul 07 14:14:53.987225 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.987180 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" containerName="console" Jul 07 14:14:53.987265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.987256 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b2ccdf5-0bf0-42ed-8d62-8d811e876865" containerName="console" Jul 07 14:14:53.990093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.990077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:53.992997 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.992979 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:14:53.994250 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.994229 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:14:53.994335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:53.994232 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q9l4b\"" Jul 07 14:14:54.002998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.002912 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb"] Jul 07 14:14:54.012175 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.012144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.012276 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.012193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.012276 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.012256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86s2j\" (UniqueName: \"kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.113001 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.112969 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.113142 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.113013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.113142 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.113050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86s2j\" (UniqueName: \"kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.113330 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.113310 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.113397 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.113347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.123871 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.123848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86s2j\" (UniqueName: \"kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.299987 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.299909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:14:54.426201 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.426168 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb"] Jul 07 14:14:54.429527 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:14:54.429494 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58c16d2_b85d_47d9_8ea9_742866567dfa.slice/crio-f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437 WatchSource:0}: Error finding container f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437: Status 404 returned error can't find the container with id f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437 Jul 07 14:14:54.431559 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:54.431543 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:14:55.150589 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:14:55.150543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" event={"ID":"c58c16d2-b85d-47d9-8ea9-742866567dfa","Type":"ContainerStarted","Data":"f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437"} Jul 07 14:15:03.182529 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:03.182495 2560 generic.go:356] "Generic (PLEG): container finished" podID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerID="156642a0b833cb093bf077777d6c8d0b63a73b68a509370b8d8fb2f0d8bec10d" exitCode=0 Jul 07 14:15:03.182945 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:03.182555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" event={"ID":"c58c16d2-b85d-47d9-8ea9-742866567dfa","Type":"ContainerDied","Data":"156642a0b833cb093bf077777d6c8d0b63a73b68a509370b8d8fb2f0d8bec10d"} Jul 07 14:15:05.191565 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:05.191532 2560 generic.go:356] "Generic (PLEG): container finished" podID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerID="620201e29af390598718875aaef2732a6b741d07c52af12f28a89bd1b9b3d3fe" exitCode=0 Jul 07 14:15:05.191913 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:05.191625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" event={"ID":"c58c16d2-b85d-47d9-8ea9-742866567dfa","Type":"ContainerDied","Data":"620201e29af390598718875aaef2732a6b741d07c52af12f28a89bd1b9b3d3fe"} Jul 07 14:15:14.229028 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:14.228992 2560 generic.go:356] "Generic (PLEG): container finished" podID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerID="06a1919e5d86f90c3eb5cebae3d59c3c47a59197a4d413614270d8aec82e6588" exitCode=0 Jul 07 14:15:14.229417 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:14.229041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" event={"ID":"c58c16d2-b85d-47d9-8ea9-742866567dfa","Type":"ContainerDied","Data":"06a1919e5d86f90c3eb5cebae3d59c3c47a59197a4d413614270d8aec82e6588"} Jul 07 14:15:15.298983 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.298883 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:15.391424 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.391398 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:15:15.395842 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.395815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:15.471345 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.471324 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86s2j\" (UniqueName: \"kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j\") pod \"c58c16d2-b85d-47d9-8ea9-742866567dfa\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " Jul 07 14:15:15.471461 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.471360 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util\") pod \"c58c16d2-b85d-47d9-8ea9-742866567dfa\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " Jul 07 14:15:15.471461 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.471389 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle\") pod \"c58c16d2-b85d-47d9-8ea9-742866567dfa\" (UID: \"c58c16d2-b85d-47d9-8ea9-742866567dfa\") " Jul 07 14:15:15.472017 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.471991 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle" (OuterVolumeSpecName: "bundle") pod "c58c16d2-b85d-47d9-8ea9-742866567dfa" (UID: "c58c16d2-b85d-47d9-8ea9-742866567dfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:15:15.473498 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.473478 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j" (OuterVolumeSpecName: "kube-api-access-86s2j") pod "c58c16d2-b85d-47d9-8ea9-742866567dfa" (UID: "c58c16d2-b85d-47d9-8ea9-742866567dfa"). InnerVolumeSpecName "kube-api-access-86s2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:15:15.475776 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.475755 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util" (OuterVolumeSpecName: "util") pod "c58c16d2-b85d-47d9-8ea9-742866567dfa" (UID: "c58c16d2-b85d-47d9-8ea9-742866567dfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:15:15.572717 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.572661 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86s2j\" (UniqueName: \"kubernetes.io/projected/c58c16d2-b85d-47d9-8ea9-742866567dfa-kube-api-access-86s2j\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:15:15.572717 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.572683 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-util\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:15:15.572717 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:15.572694 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58c16d2-b85d-47d9-8ea9-742866567dfa-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:15:16.237389 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:16.237358 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" event={"ID":"c58c16d2-b85d-47d9-8ea9-742866567dfa","Type":"ContainerDied","Data":"f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437"} Jul 07 14:15:16.237389 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:16.237380 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589tjwdb" Jul 07 14:15:16.237589 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:16.237403 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f235a61099f98785cef4fcde653e4b35f07fc971b79ffa5c5ae4c10209a28437" Jul 07 14:15:20.397447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:20.397410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:20.492883 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:20.492846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:22.187890 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.187858 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g"] Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188106 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="extract" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188116 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="extract" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188132 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="util" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188138 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="util" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188147 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="pull" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188152 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="pull" Jul 07 14:15:22.188267 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.188197 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58c16d2-b85d-47d9-8ea9-742866567dfa" containerName="extract" Jul 07 14:15:22.191220 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.191203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.195466 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.195422 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 07 14:15:22.195608 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.195466 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 07 14:15:22.195608 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.195546 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-6vv84\"" Jul 07 14:15:22.198327 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.198311 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 07 14:15:22.208357 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.208330 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g"] Jul 07 14:15:22.323840 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.323815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.323980 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.323864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9nns\" (UniqueName: \"kubernetes.io/projected/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-kube-api-access-p9nns\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.424844 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.424818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9nns\" (UniqueName: \"kubernetes.io/projected/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-kube-api-access-p9nns\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.424937 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.424866 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.427088 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.427058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.439957 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.439905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9nns\" (UniqueName: \"kubernetes.io/projected/0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1-kube-api-access-p9nns\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g\" (UID: \"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.500879 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.500858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:22.631861 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:22.631838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g"] Jul 07 14:15:22.634507 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:15:22.634484 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9a8be4_cbf6_4e38_9a8f_b92e3d6177a1.slice/crio-2d4540d6e9198a459456894a996e36c01022b9726f0935dfa65049720ef8b065 WatchSource:0}: Error finding container 2d4540d6e9198a459456894a996e36c01022b9726f0935dfa65049720ef8b065: Status 404 returned error can't find the container with id 2d4540d6e9198a459456894a996e36c01022b9726f0935dfa65049720ef8b065 Jul 07 14:15:23.262655 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:23.262618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" event={"ID":"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1","Type":"ContainerStarted","Data":"2d4540d6e9198a459456894a996e36c01022b9726f0935dfa65049720ef8b065"} Jul 07 14:15:25.843080 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:25.843002 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:26.161642 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.161610 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:26.162121 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.162092 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-kl82b"] Jul 07 14:15:26.165353 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.165331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.168069 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.167967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 07 14:15:26.168166 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.168079 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-hmn8c\"" Jul 07 14:15:26.168166 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.167968 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 07 14:15:26.176551 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.176329 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-kl82b"] Jul 07 14:15:26.256134 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.256110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48kd\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-kube-api-access-h48kd\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.256251 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.256164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.256251 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.256199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-cabundle0\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.277085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.277058 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" event={"ID":"0b9a8be4-cbf6-4e38-9a8f-b92e3d6177a1","Type":"ContainerStarted","Data":"26ed90e2802c8c82ff9313e650a6ea132ffd305ec9f9dfe8747d5ebbc485f2d6"} Jul 07 14:15:26.277196 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.277184 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:26.356814 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.356787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.356919 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.356840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-cabundle0\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.356919 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.356894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48kd\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-kube-api-access-h48kd\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.357229 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.357031 2560 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 07 14:15:26.357229 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.357056 2560 secret.go:281] references non-existent secret key: ca.crt Jul 07 14:15:26.357229 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.357068 2560 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 07 14:15:26.357229 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.357082 2560 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-kl82b: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 07 14:15:26.357229 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.357135 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates podName:60ca3cd2-7b8c-4322-82f3-e24d9d79b287 nodeName:}" failed. No retries permitted until 2026-07-07 14:15:26.857117499 +0000 UTC m=+341.354727394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates") pod "keda-operator-68bff59c-kl82b" (UID: "60ca3cd2-7b8c-4322-82f3-e24d9d79b287") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 07 14:15:26.357550 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.357529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-cabundle0\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.369385 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.369357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48kd\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-kube-api-access-h48kd\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.538732 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.538641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:26.861768 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:26.861676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:26.862108 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.861844 2560 secret.go:281] references non-existent secret key: ca.crt Jul 07 14:15:26.862108 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.861864 2560 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 07 14:15:26.862108 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.861873 2560 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-kl82b: references non-existent secret key: ca.crt Jul 07 14:15:26.862108 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:15:26.861928 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates podName:60ca3cd2-7b8c-4322-82f3-e24d9d79b287 nodeName:}" failed. No retries permitted until 2026-07-07 14:15:27.861913357 +0000 UTC m=+342.359523236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates") pod "keda-operator-68bff59c-kl82b" (UID: "60ca3cd2-7b8c-4322-82f3-e24d9d79b287") : references non-existent secret key: ca.crt Jul 07 14:15:27.007324 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.007285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:27.224429 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.224364 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" podStartSLOduration=2.447580595 podStartE2EDuration="5.224343586s" totalImagesPullingTime="2.776762991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:26.305383909 +0000 UTC m=+340.802993811" watchObservedRunningTime="2026-07-07 14:15:27.224343586 +0000 UTC m=+341.721953489" Jul 07 14:15:27.225684 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.225666 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5"] Jul 07 14:15:27.228841 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.228823 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.231759 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.231738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 07 14:15:27.238947 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.238922 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5"] Jul 07 14:15:27.267638 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.267614 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:27.365316 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.365286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdql\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-kube-api-access-5qdql\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.365441 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.365422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.365516 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.365465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-certificates\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.425905 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.425859 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:27.465932 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.465901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.465932 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.465936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-certificates\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.466093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.465962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdql\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-kube-api-access-5qdql\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.466356 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.466336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.468541 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.468514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-certificates\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.474501 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.474438 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdql\" (UniqueName: \"kubernetes.io/projected/3e949b8b-d1c7-483c-ab77-8cff4b12fb2d-kube-api-access-5qdql\") pod \"keda-metrics-apiserver-559f75f947-hsqd5\" (UID: \"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.522019 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.521993 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:27.540090 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.540066 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:27.677460 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.677354 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5"] Jul 07 14:15:27.680246 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:15:27.680223 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e949b8b_d1c7_483c_ab77_8cff4b12fb2d.slice/crio-1c7ccbfd88d5c337434e67c82d6615864d26fba0b321c45ffb2fb7cb70fcad9e WatchSource:0}: Error finding container 1c7ccbfd88d5c337434e67c82d6615864d26fba0b321c45ffb2fb7cb70fcad9e: Status 404 returned error can't find the container with id 1c7ccbfd88d5c337434e67c82d6615864d26fba0b321c45ffb2fb7cb70fcad9e Jul 07 14:15:27.869858 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.869775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:27.872180 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.872155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/60ca3cd2-7b8c-4322-82f3-e24d9d79b287-certificates\") pod \"keda-operator-68bff59c-kl82b\" (UID: \"60ca3cd2-7b8c-4322-82f3-e24d9d79b287\") " pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:27.979093 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:27.979068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:28.112895 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:28.112867 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-kl82b"] Jul 07 14:15:28.115862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:15:28.115819 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ca3cd2_7b8c_4322_82f3_e24d9d79b287.slice/crio-07bb5b3dbe3af2fa9cc09a09374919e978698b280554c72cf0898cfb2a732a17 WatchSource:0}: Error finding container 07bb5b3dbe3af2fa9cc09a09374919e978698b280554c72cf0898cfb2a732a17: Status 404 returned error can't find the container with id 07bb5b3dbe3af2fa9cc09a09374919e978698b280554c72cf0898cfb2a732a17 Jul 07 14:15:28.243193 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:28.243157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:28.286393 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:28.286361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-kl82b" event={"ID":"60ca3cd2-7b8c-4322-82f3-e24d9d79b287","Type":"ContainerStarted","Data":"07bb5b3dbe3af2fa9cc09a09374919e978698b280554c72cf0898cfb2a732a17"} Jul 07 14:15:28.287728 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:28.287685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" event={"ID":"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d","Type":"ContainerStarted","Data":"1c7ccbfd88d5c337434e67c82d6615864d26fba0b321c45ffb2fb7cb70fcad9e"} Jul 07 14:15:28.342225 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:28.342197 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:30.297891 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:30.297854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" event={"ID":"3e949b8b-d1c7-483c-ab77-8cff4b12fb2d","Type":"ContainerStarted","Data":"99e0a5cbd4c5a5bd11624a0f65d0db17e6c089ea222863b5d02d20f0a929639f"} Jul 07 14:15:30.298330 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:30.297930 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:30.317230 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:30.317183 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" podStartSLOduration=0.86216777 podStartE2EDuration="3.317163592s" totalImagesPullingTime="2.454995822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:30.316225146 +0000 UTC m=+344.813835048" watchObservedRunningTime="2026-07-07 14:15:30.317163592 +0000 UTC m=+344.814773530" Jul 07 14:15:32.306635 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:32.306597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-kl82b" event={"ID":"60ca3cd2-7b8c-4322-82f3-e24d9d79b287","Type":"ContainerStarted","Data":"39576bb041aaa3f26c247d013150ad6afa94a0afc096bc8891d42ed948f1c8b7"} Jul 07 14:15:32.307027 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:32.306719 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:15:32.331418 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:32.331371 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-kl82b" podStartSLOduration=3.033460766 podStartE2EDuration="6.331357924s" totalImagesPullingTime="3.297897158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:32.330070417 +0000 UTC m=+346.827680317" watchObservedRunningTime="2026-07-07 14:15:32.331357924 +0000 UTC m=+346.828967825" Jul 07 14:15:33.022402 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:33.022372 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:33.098173 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:33.098129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:41.306726 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:41.306648 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-hsqd5" Jul 07 14:15:47.283408 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:47.283376 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8wt8g" Jul 07 14:15:53.313233 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:15:53.313202 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-kl82b" Jul 07 14:16:35.197203 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.197166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:35.274601 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.274556 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:16:35.277665 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.277647 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.280262 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.280238 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 07 14:16:35.280262 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.280267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-88trt\"" Jul 07 14:16:35.281393 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.281348 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:16:35.281542 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.281525 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:16:35.292717 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.292629 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:16:35.336206 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.336168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fphjj\" (UniqueName: \"kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.336335 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.336226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.436581 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.436547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fphjj\" (UniqueName: \"kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.436739 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.436610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.439069 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.439040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.451899 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.451843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fphjj\" (UniqueName: \"kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj\") pod \"kserve-controller-manager-7598d7bb4-xkwql\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.598013 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.597978 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:35.725311 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:35.725238 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:16:35.728401 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:16:35.728374 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2f135c_8aa2_4f9c_94f0_504f28ab1d29.slice/crio-6c53d651f109dcafaa628bc331c7b2bfc353d1e1f51b6b9428a8183e15ae05d3 WatchSource:0}: Error finding container 6c53d651f109dcafaa628bc331c7b2bfc353d1e1f51b6b9428a8183e15ae05d3: Status 404 returned error can't find the container with id 6c53d651f109dcafaa628bc331c7b2bfc353d1e1f51b6b9428a8183e15ae05d3 Jul 07 14:16:36.435783 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:36.435746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:36.511079 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:36.511044 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:36.535129 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:36.535090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" event={"ID":"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29","Type":"ContainerStarted","Data":"6c53d651f109dcafaa628bc331c7b2bfc353d1e1f51b6b9428a8183e15ae05d3"} Jul 07 14:16:39.548197 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:39.548106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" event={"ID":"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29","Type":"ContainerStarted","Data":"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166"} Jul 07 14:16:39.548562 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:39.548227 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:16:39.566440 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:16:39.566393 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" podStartSLOduration=1.147379796 podStartE2EDuration="4.566377701s" totalImagesPullingTime="3.418997905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:39.565867298 +0000 UTC m=+414.063477211" watchObservedRunningTime="2026-07-07 14:16:39.566377701 +0000 UTC m=+414.063987631" Jul 07 14:17:10.557788 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:10.557708 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:17:11.674101 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.674069 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:17:11.674506 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.674247 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" podUID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" containerName="manager" containerID="cri-o://40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166" gracePeriod=10 Jul 07 14:17:11.698672 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.698650 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-588f4"] Jul 07 14:17:11.701656 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.701637 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.710851 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.710832 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-588f4"] Jul 07 14:17:11.788515 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.788489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h86x\" (UniqueName: \"kubernetes.io/projected/5427ba84-463d-46fb-ae0c-16f8aa8670fd-kube-api-access-7h86x\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.788650 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.788531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5427ba84-463d-46fb-ae0c-16f8aa8670fd-cert\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.888954 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.888922 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h86x\" (UniqueName: \"kubernetes.io/projected/5427ba84-463d-46fb-ae0c-16f8aa8670fd-kube-api-access-7h86x\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.889091 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.888986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5427ba84-463d-46fb-ae0c-16f8aa8670fd-cert\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.891179 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.891157 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5427ba84-463d-46fb-ae0c-16f8aa8670fd-cert\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.899066 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.899048 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h86x\" (UniqueName: \"kubernetes.io/projected/5427ba84-463d-46fb-ae0c-16f8aa8670fd-kube-api-access-7h86x\") pod \"kserve-controller-manager-7598d7bb4-588f4\" (UID: \"5427ba84-463d-46fb-ae0c-16f8aa8670fd\") " pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:11.916630 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.916608 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:17:11.989480 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.989416 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fphjj\" (UniqueName: \"kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj\") pod \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " Jul 07 14:17:11.989480 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.989464 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert\") pod \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\" (UID: \"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29\") " Jul 07 14:17:11.991524 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.991497 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj" (OuterVolumeSpecName: "kube-api-access-fphjj") pod "1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" (UID: "1f2f135c-8aa2-4f9c-94f0-504f28ab1d29"). InnerVolumeSpecName "kube-api-access-fphjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:17:11.991524 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:11.991507 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert" (OuterVolumeSpecName: "cert") pod "1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" (UID: "1f2f135c-8aa2-4f9c-94f0-504f28ab1d29"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:17:12.045116 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.045091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:12.090998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.090850 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fphjj\" (UniqueName: \"kubernetes.io/projected/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-kube-api-access-fphjj\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:17:12.090998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.090883 2560 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:17:12.173565 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.173538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-588f4"] Jul 07 14:17:12.176763 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:17:12.176729 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5427ba84_463d_46fb_ae0c_16f8aa8670fd.slice/crio-d445b1209bfeeaf060492eb504697b5d1a6a584247386916a88ee9d77b96b6c0 WatchSource:0}: Error finding container d445b1209bfeeaf060492eb504697b5d1a6a584247386916a88ee9d77b96b6c0: Status 404 returned error can't find the container with id d445b1209bfeeaf060492eb504697b5d1a6a584247386916a88ee9d77b96b6c0 Jul 07 14:17:12.664464 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.664428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" event={"ID":"5427ba84-463d-46fb-ae0c-16f8aa8670fd","Type":"ContainerStarted","Data":"d445b1209bfeeaf060492eb504697b5d1a6a584247386916a88ee9d77b96b6c0"} Jul 07 14:17:12.665556 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.665525 2560 generic.go:356] "Generic (PLEG): container finished" podID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" containerID="40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166" exitCode=0 Jul 07 14:17:12.665709 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.665595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" event={"ID":"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29","Type":"ContainerDied","Data":"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166"} Jul 07 14:17:12.665709 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.665603 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" Jul 07 14:17:12.665709 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.665637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-xkwql" event={"ID":"1f2f135c-8aa2-4f9c-94f0-504f28ab1d29","Type":"ContainerDied","Data":"6c53d651f109dcafaa628bc331c7b2bfc353d1e1f51b6b9428a8183e15ae05d3"} Jul 07 14:17:12.665709 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.665663 2560 scope.go:117] "RemoveContainer" containerID="40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166" Jul 07 14:17:12.673619 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.673596 2560 scope.go:117] "RemoveContainer" containerID="40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166" Jul 07 14:17:12.673905 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:17:12.673877 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166\": container with ID starting with 40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166 not found: ID does not exist" containerID="40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166" Jul 07 14:17:12.673978 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.673916 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166"} err="failed to get container status \"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166\": rpc error: code = NotFound desc = could not find container \"40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166\": container with ID starting with 40c880bee544b04520d8dedca3b1d11776a992cf71680f7df1b3eb1d35e66166 not found: ID does not exist" Jul 07 14:17:12.685362 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.685331 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:17:12.694954 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:12.694934 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-xkwql"] Jul 07 14:17:13.671178 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:13.671142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" event={"ID":"5427ba84-463d-46fb-ae0c-16f8aa8670fd","Type":"ContainerStarted","Data":"0f064362a455cd14a6af311ba24c98740b8e7b6dc26bc638f90f1f0b2a9b855b"} Jul 07 14:17:13.671358 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:13.671225 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:13.690649 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:13.690603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" podStartSLOduration=2.051112911 podStartE2EDuration="2.690589169s" totalImagesPullingTime="639.476258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:13.690205284 +0000 UTC m=+448.187815186" watchObservedRunningTime="2026-07-07 14:17:13.690589169 +0000 UTC m=+448.188199061" Jul 07 14:17:13.999174 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:13.999094 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" path="/var/lib/kubelet/pods/1f2f135c-8aa2-4f9c-94f0-504f28ab1d29/volumes" Jul 07 14:17:16.241447 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:16.241416 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:16.338430 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:16.338402 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:44.679650 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:44.679620 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7598d7bb4-588f4" Jul 07 14:17:45.829076 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.829039 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:45.916784 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.916751 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:45.917045 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.917024 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kp5n6"] Jul 07 14:17:45.917434 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.917421 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" containerName="manager" Jul 07 14:17:45.917473 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.917438 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" containerName="manager" Jul 07 14:17:45.917506 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.917497 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2f135c-8aa2-4f9c-94f0-504f28ab1d29" containerName="manager" Jul 07 14:17:45.921789 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.921770 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:45.925121 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.925100 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-cfpkw\"" Jul 07 14:17:45.925230 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.925145 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 07 14:17:45.936188 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:45.936165 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kp5n6"] Jul 07 14:17:46.021786 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.021757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm875\" (UniqueName: \"kubernetes.io/projected/8dce1800-30b6-4200-8754-c9548f3053d4-kube-api-access-vm875\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.021945 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.021814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dce1800-30b6-4200-8754-c9548f3053d4-cert\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.119742 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.119660 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:46.122643 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.122621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm875\" (UniqueName: \"kubernetes.io/projected/8dce1800-30b6-4200-8754-c9548f3053d4-kube-api-access-vm875\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.122761 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.122657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dce1800-30b6-4200-8754-c9548f3053d4-cert\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.124925 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.124905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dce1800-30b6-4200-8754-c9548f3053d4-cert\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.132975 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.132953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm875\" (UniqueName: \"kubernetes.io/projected/8dce1800-30b6-4200-8754-c9548f3053d4-kube-api-access-vm875\") pod \"odh-model-controller-84b54b7f97-kp5n6\" (UID: \"8dce1800-30b6-4200-8754-c9548f3053d4\") " pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.226809 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.226777 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:46.231712 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.231692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:46.363884 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.363861 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kp5n6"] Jul 07 14:17:46.365980 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:17:46.365954 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dce1800_30b6_4200_8754_c9548f3053d4.slice/crio-576f5e47009f165d5bf934e141651f8425d82725c048620a740ef196c4a9d49c WatchSource:0}: Error finding container 576f5e47009f165d5bf934e141651f8425d82725c048620a740ef196c4a9d49c: Status 404 returned error can't find the container with id 576f5e47009f165d5bf934e141651f8425d82725c048620a740ef196c4a9d49c Jul 07 14:17:46.702745 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.702711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:46.790906 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.790873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" event={"ID":"8dce1800-30b6-4200-8754-c9548f3053d4","Type":"ContainerStarted","Data":"576f5e47009f165d5bf934e141651f8425d82725c048620a740ef196c4a9d49c"} Jul 07 14:17:46.803242 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:46.803218 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:50.808277 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:50.808246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" event={"ID":"8dce1800-30b6-4200-8754-c9548f3053d4","Type":"ContainerStarted","Data":"1245fc5de0259c28d77bc8dd4a5733d87f0eda4a61695aad43801916c5824efa"} Jul 07 14:17:50.808650 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:50.808315 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:17:50.830256 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:17:50.830210 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" podStartSLOduration=2.431389929 podStartE2EDuration="5.830195549s" totalImagesPullingTime="3.39880562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:50.829022741 +0000 UTC m=+485.326632645" watchObservedRunningTime="2026-07-07 14:17:50.830195549 +0000 UTC m=+485.327805450" Jul 07 14:18:01.814363 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:18:01.814334 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-kp5n6" Jul 07 14:18:23.811434 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:18:23.811396 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:12.203097 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:12.203062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:12.265807 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:12.265780 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:18.912762 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:18.912710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:22.679699 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.679663 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:22.694758 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.694728 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:22.697714 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.697700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.700628 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.700609 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zrcbk\"" Jul 07 14:19:22.701041 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.701018 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 07 14:19:22.706280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.706260 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:22.793155 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.793125 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xrb\" (UniqueName: \"kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.793326 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.793174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.894408 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.894359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xrb\" (UniqueName: \"kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.894613 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.894433 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.894901 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.894881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:22.908410 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:22.908380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xrb\" (UniqueName: \"kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb\") pod \"seaweedfs-tls-custom-6644bf5d6c-rj4vn\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:23.007775 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:23.007698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:23.134565 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:23.134537 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:23.138225 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:19:23.138199 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c2d7a6_655c_4c0d_b62e_7177479121d9.slice/crio-f97b04515b5e731a9f77cf0afaeead2e637e9b82460745ba0d01189f8daea082 WatchSource:0}: Error finding container f97b04515b5e731a9f77cf0afaeead2e637e9b82460745ba0d01189f8daea082: Status 404 returned error can't find the container with id f97b04515b5e731a9f77cf0afaeead2e637e9b82460745ba0d01189f8daea082 Jul 07 14:19:24.142113 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:24.142076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" event={"ID":"e3c2d7a6-655c-4c0d-b62e-7177479121d9","Type":"ContainerStarted","Data":"f97b04515b5e731a9f77cf0afaeead2e637e9b82460745ba0d01189f8daea082"} Jul 07 14:19:28.159544 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:28.159508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" event={"ID":"e3c2d7a6-655c-4c0d-b62e-7177479121d9","Type":"ContainerStarted","Data":"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92"} Jul 07 14:19:28.178909 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:28.178865 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" podStartSLOduration=2.033364448 podStartE2EDuration="6.178853226s" totalImagesPullingTime="4.145488778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:19:28.177732823 +0000 UTC m=+582.675342724" watchObservedRunningTime="2026-07-07 14:19:28.178853226 +0000 UTC m=+582.676463126" Jul 07 14:19:29.394304 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:29.394271 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:30.166970 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:30.166933 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" podUID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" containerName="seaweedfs-tls-custom" containerID="cri-o://d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92" gracePeriod=30 Jul 07 14:19:57.999745 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:57.999722 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:58.144806 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.144766 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data\") pod \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " Jul 07 14:19:58.144946 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.144818 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9xrb\" (UniqueName: \"kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb\") pod \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\" (UID: \"e3c2d7a6-655c-4c0d-b62e-7177479121d9\") " Jul 07 14:19:58.146049 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.146023 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data" (OuterVolumeSpecName: "data") pod "e3c2d7a6-655c-4c0d-b62e-7177479121d9" (UID: "e3c2d7a6-655c-4c0d-b62e-7177479121d9"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:19:58.146898 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.146876 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb" (OuterVolumeSpecName: "kube-api-access-r9xrb") pod "e3c2d7a6-655c-4c0d-b62e-7177479121d9" (UID: "e3c2d7a6-655c-4c0d-b62e-7177479121d9"). InnerVolumeSpecName "kube-api-access-r9xrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:19:58.245480 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.245454 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9xrb\" (UniqueName: \"kubernetes.io/projected/e3c2d7a6-655c-4c0d-b62e-7177479121d9-kube-api-access-r9xrb\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:19:58.245480 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.245475 2560 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3c2d7a6-655c-4c0d-b62e-7177479121d9-data\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:19:58.276175 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.276151 2560 generic.go:356] "Generic (PLEG): container finished" podID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" containerID="d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92" exitCode=0 Jul 07 14:19:58.276280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.276191 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" Jul 07 14:19:58.276280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.276208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" event={"ID":"e3c2d7a6-655c-4c0d-b62e-7177479121d9","Type":"ContainerDied","Data":"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92"} Jul 07 14:19:58.276280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.276246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn" event={"ID":"e3c2d7a6-655c-4c0d-b62e-7177479121d9","Type":"ContainerDied","Data":"f97b04515b5e731a9f77cf0afaeead2e637e9b82460745ba0d01189f8daea082"} Jul 07 14:19:58.276280 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.276264 2560 scope.go:117] "RemoveContainer" containerID="d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92" Jul 07 14:19:58.285986 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.285969 2560 scope.go:117] "RemoveContainer" containerID="d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92" Jul 07 14:19:58.286237 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:19:58.286221 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92\": container with ID starting with d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92 not found: ID does not exist" containerID="d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92" Jul 07 14:19:58.286319 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.286246 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92"} err="failed to get container status \"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92\": rpc error: code = NotFound desc = could not find container \"d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92\": container with ID starting with d04a4ce0ac57d4487bf60aa15a0cf38da165749b1037af3ecca6c11947413c92 not found: ID does not exist" Jul 07 14:19:58.298408 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.298385 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:58.305622 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.305596 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-rj4vn"] Jul 07 14:19:58.341505 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.341483 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-8cbpv"] Jul 07 14:19:58.341787 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.341774 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" containerName="seaweedfs-tls-custom" Jul 07 14:19:58.341834 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.341790 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" containerName="seaweedfs-tls-custom" Jul 07 14:19:58.341872 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.341841 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" containerName="seaweedfs-tls-custom" Jul 07 14:19:58.346647 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.346631 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.349397 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.349375 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 07 14:19:58.349397 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.349393 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zrcbk\"" Jul 07 14:19:58.349553 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.349375 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 07 14:19:58.355629 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.355611 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-8cbpv"] Jul 07 14:19:58.447856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.447798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.447856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.447827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqdc\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-kube-api-access-vxqdc\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.447856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.447845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c026212c-ebf4-4a90-8ee2-84796758bcdb-data\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.548192 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.548166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.548289 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.548207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqdc\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-kube-api-access-vxqdc\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.548289 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.548231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c026212c-ebf4-4a90-8ee2-84796758bcdb-data\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.548588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.548553 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c026212c-ebf4-4a90-8ee2-84796758bcdb-data\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.550481 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.550460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.559336 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.559311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqdc\" (UniqueName: \"kubernetes.io/projected/c026212c-ebf4-4a90-8ee2-84796758bcdb-kube-api-access-vxqdc\") pod \"seaweedfs-tls-custom-8b44d767d-8cbpv\" (UID: \"c026212c-ebf4-4a90-8ee2-84796758bcdb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.655347 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.655323 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" Jul 07 14:19:58.778214 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.778184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-8cbpv"] Jul 07 14:19:58.780862 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:19:58.780840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc026212c_ebf4_4a90_8ee2_84796758bcdb.slice/crio-f7ea0966080930e9f0a0adbe54b23a8225473bed8e9b4a9162fcf42215aa17bb WatchSource:0}: Error finding container f7ea0966080930e9f0a0adbe54b23a8225473bed8e9b4a9162fcf42215aa17bb: Status 404 returned error can't find the container with id f7ea0966080930e9f0a0adbe54b23a8225473bed8e9b4a9162fcf42215aa17bb Jul 07 14:19:58.782223 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:58.782205 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:19:59.282470 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:59.282386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" event={"ID":"c026212c-ebf4-4a90-8ee2-84796758bcdb","Type":"ContainerStarted","Data":"9515f5ad42c20ac9affd5ae6ca0e14c51b041d09b4b24ea8f6094b707aa58ccd"} Jul 07 14:19:59.282470 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:59.282461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" event={"ID":"c026212c-ebf4-4a90-8ee2-84796758bcdb","Type":"ContainerStarted","Data":"f7ea0966080930e9f0a0adbe54b23a8225473bed8e9b4a9162fcf42215aa17bb"} Jul 07 14:19:59.302481 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:59.302423 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-8cbpv" podStartSLOduration=1.0520897 podStartE2EDuration="1.302407073s" totalImagesPullingTime="250.317373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:19:59.302125555 +0000 UTC m=+613.799735456" watchObservedRunningTime="2026-07-07 14:19:59.302407073 +0000 UTC m=+613.800016976" Jul 07 14:19:59.998869 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:19:59.998835 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3c2d7a6-655c-4c0d-b62e-7177479121d9" path="/var/lib/kubelet/pods/e3c2d7a6-655c-4c0d-b62e-7177479121d9/volumes" Jul 07 14:20:10.816051 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.815963 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:10.816835 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.816814 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd"] Jul 07 14:20:10.820808 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.820792 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:10.824684 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.824665 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 07 14:20:10.824888 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.824872 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 07 14:20:10.831126 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.831100 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd"] Jul 07 14:20:10.944998 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.944966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:10.945156 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.945016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-data\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:10.945156 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:10.945085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr768\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-kube-api-access-gr768\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.046017 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.045986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr768\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-kube-api-access-gr768\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.046161 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.046068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.046161 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.046110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-data\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.046492 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.046471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-data\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.048300 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.048282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.059640 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.059614 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr768\" (UniqueName: \"kubernetes.io/projected/178ec9f7-0a2c-4f97-b6c3-fc84688f03dd-kube-api-access-gr768\") pod \"seaweedfs-tls-serving-67b7477c6d-tgfzd\" (UID: \"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.130450 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.130430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" Jul 07 14:20:11.261170 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.261149 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd"] Jul 07 14:20:11.263619 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:20:11.263591 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178ec9f7_0a2c_4f97_b6c3_fc84688f03dd.slice/crio-ac4af07c580e1868ab0ce4308b836860f51ecc58f5c21a7d4fbe587cb98d7dc6 WatchSource:0}: Error finding container ac4af07c580e1868ab0ce4308b836860f51ecc58f5c21a7d4fbe587cb98d7dc6: Status 404 returned error can't find the container with id ac4af07c580e1868ab0ce4308b836860f51ecc58f5c21a7d4fbe587cb98d7dc6 Jul 07 14:20:11.352156 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:11.352128 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" event={"ID":"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd","Type":"ContainerStarted","Data":"ac4af07c580e1868ab0ce4308b836860f51ecc58f5c21a7d4fbe587cb98d7dc6"} Jul 07 14:20:12.246638 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:12.246603 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:12.357499 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:12.357466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" event={"ID":"178ec9f7-0a2c-4f97-b6c3-fc84688f03dd","Type":"ContainerStarted","Data":"40008041c11fe6067d4329307928944e4001b1736db873fe5123af453680ddc9"} Jul 07 14:20:12.379919 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:12.379872 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-tgfzd" podStartSLOduration=2.118758349 podStartE2EDuration="2.379859918s" totalImagesPullingTime="261.101569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:20:12.378444259 +0000 UTC m=+626.876054171" watchObservedRunningTime="2026-07-07 14:20:12.379859918 +0000 UTC m=+626.877469818" Jul 07 14:20:22.593300 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:22.593256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:22.734538 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:22.734505 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:24.795586 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:24.795537 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:24.901944 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:24.901916 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:34.466963 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:34.466928 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:34.645503 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:20:34.645474 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:29.872708 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:29.872671 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:29.977408 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:29.977346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:30.096288 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:30.096254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:59.650644 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.650614 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668c9c757b-qjj2z"] Jul 07 14:22:59.653724 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.653693 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.670156 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.670133 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668c9c757b-qjj2z"] Jul 07 14:22:59.677997 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.677975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678101 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-oauth-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678101 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678172 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-oauth-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678208 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6n5r\" (UniqueName: \"kubernetes.io/projected/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-kube-api-access-n6n5r\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678246 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-trusted-ca-bundle\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.678291 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.678248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-service-ca\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.727666 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.727639 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:59.778838 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778812 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.778938 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-oauth-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.778938 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778874 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-oauth-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6n5r\" (UniqueName: \"kubernetes.io/projected/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-kube-api-access-n6n5r\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.778988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-trusted-ca-bundle\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779104 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.779012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-service-ca\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779606 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.779557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-oauth-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779691 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.779652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-service-ca\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779797 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.779773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.779910 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.779827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-trusted-ca-bundle\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.781343 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.781324 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-serving-cert\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.781419 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.781389 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-console-oauth-config\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.788960 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.788943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6n5r\" (UniqueName: \"kubernetes.io/projected/ee9d26fb-7fc1-4134-aaac-1dfab0d7b683-kube-api-access-n6n5r\") pod \"console-668c9c757b-qjj2z\" (UID: \"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683\") " pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:22:59.962286 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:22:59.962198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:23:00.129486 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:00.129452 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668c9c757b-qjj2z"] Jul 07 14:23:00.132214 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:23:00.132194 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9d26fb_7fc1_4134_aaac_1dfab0d7b683.slice/crio-3696f360b36298ae996eeccb1cb748b8146f104f8642fb252e55a155f8636941 WatchSource:0}: Error finding container 3696f360b36298ae996eeccb1cb748b8146f104f8642fb252e55a155f8636941: Status 404 returned error can't find the container with id 3696f360b36298ae996eeccb1cb748b8146f104f8642fb252e55a155f8636941 Jul 07 14:23:01.011181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:01.011146 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668c9c757b-qjj2z" event={"ID":"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683","Type":"ContainerStarted","Data":"3d08ed2316a8dc8b3ecb6b08c35e864d8025c8dea3a7d6758d9b73eb182be2ce"} Jul 07 14:23:01.011686 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:01.011226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668c9c757b-qjj2z" event={"ID":"ee9d26fb-7fc1-4134-aaac-1dfab0d7b683","Type":"ContainerStarted","Data":"3696f360b36298ae996eeccb1cb748b8146f104f8642fb252e55a155f8636941"} Jul 07 14:23:01.035203 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:01.035148 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668c9c757b-qjj2z" podStartSLOduration=2.035133409 podStartE2EDuration="2.035133409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:23:01.033908403 +0000 UTC m=+795.531518306" watchObservedRunningTime="2026-07-07 14:23:01.035133409 +0000 UTC m=+795.532743309" Jul 07 14:23:09.963012 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:09.962921 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:23:09.963012 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:09.962977 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:23:09.967683 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:09.967659 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:23:10.050016 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.049986 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668c9c757b-qjj2z" Jul 07 14:23:10.301496 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.301415 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:10.396621 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.396587 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:10.712495 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.712469 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:23:10.905510 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.905479 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:10.963873 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:10.963815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:35.732352 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:35.732289 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f759658dc-mkzn9" podUID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" containerName="console" containerID="cri-o://44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc" gracePeriod=15 Jul 07 14:23:35.962033 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:35.962010 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:23:36.036963 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.036884 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.036963 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.036939 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.036970 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.036988 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037013 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037046 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037071 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjjsw\" (UniqueName: \"kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw\") pod \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\" (UID: \"964fd1cd-a51a-47fc-bfe6-1400d0c390d0\") " Jul 07 14:23:36.037434 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037403 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:23:36.037486 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037430 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:23:36.037527 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037504 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config" (OuterVolumeSpecName: "console-config") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:23:36.037565 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.037538 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:23:36.039184 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.039160 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:23:36.039307 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.039207 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:23:36.039365 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.039317 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw" (OuterVolumeSpecName: "kube-api-access-bjjsw") pod "964fd1cd-a51a-47fc-bfe6-1400d0c390d0" (UID: "964fd1cd-a51a-47fc-bfe6-1400d0c390d0"). InnerVolumeSpecName "kube-api-access-bjjsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:23:36.138201 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138177 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138201 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138199 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138207 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138216 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-oauth-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138225 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-console-oauth-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138233 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjjsw\" (UniqueName: \"kubernetes.io/projected/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-kube-api-access-bjjsw\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.138361 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.138241 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/964fd1cd-a51a-47fc-bfe6-1400d0c390d0-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\"" Jul 07 14:23:36.145211 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.145184 2560 generic.go:356] "Generic (PLEG): container finished" podID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" containerID="44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc" exitCode=0 Jul 07 14:23:36.145328 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.145227 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f759658dc-mkzn9" Jul 07 14:23:36.145328 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.145274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f759658dc-mkzn9" event={"ID":"964fd1cd-a51a-47fc-bfe6-1400d0c390d0","Type":"ContainerDied","Data":"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc"} Jul 07 14:23:36.145328 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.145322 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f759658dc-mkzn9" event={"ID":"964fd1cd-a51a-47fc-bfe6-1400d0c390d0","Type":"ContainerDied","Data":"9575b9ca9903f16380ca29055b87b02823de5e975bd5af8bc766ee132cd9f83d"} Jul 07 14:23:36.145440 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.145342 2560 scope.go:117] "RemoveContainer" containerID="44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc" Jul 07 14:23:36.158937 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.158919 2560 scope.go:117] "RemoveContainer" containerID="44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc" Jul 07 14:23:36.159185 ip-10-0-130-166 kubenswrapper[2560]: E0707 14:23:36.159160 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc\": container with ID starting with 44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc not found: ID does not exist" containerID="44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc" Jul 07 14:23:36.159276 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.159188 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc"} err="failed to get container status \"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc\": rpc error: code = NotFound desc = could not find container \"44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc\": container with ID starting with 44f93bfa919bf056d5b4287c30945e2113d0dd0152a06e07a376c0f3b754c3bc not found: ID does not exist" Jul 07 14:23:36.173325 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.173299 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:23:36.178376 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:36.178354 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f759658dc-mkzn9"] Jul 07 14:23:37.999266 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:23:37.999225 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" path="/var/lib/kubelet/pods/964fd1cd-a51a-47fc-bfe6-1400d0c390d0/volumes" Jul 07 14:24:05.053711 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:24:05.053662 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:05.161045 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:24:05.161011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:05.285594 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:24:05.285540 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:25.104648 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:24:25.104612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:25.309851 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:24:25.309816 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:00.600253 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:26:00.600215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:01.908767 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:26:01.908727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:10.242618 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:26:10.242523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:33.242173 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:26:33.242123 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:33.308327 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:26:33.308296 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:28:20.030330 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:28:20.030301 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:29:10.811100 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:29:10.811022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:29:16.126168 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:29:16.126138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:29:16.357454 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:29:16.357421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:31:26.449990 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:31:26.449954 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:31:31.458216 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:31:31.458174 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:31:31.792181 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:31:31.792106 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:32:51.591805 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:32:51.591765 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:33:11.796967 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:33:11.796931 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:33:16.886086 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:33:16.886051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:33:17.289825 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:33:17.289735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:27.862061 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:35:27.861983 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:32.245167 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:35:32.245101 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:32.363179 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:35:32.363149 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:02.406621 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:02.406560 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:08.991083 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:08.991046 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:09.086860 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:09.086828 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:30.054727 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:30.054689 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:38.746846 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:38.746756 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:38.896690 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:38.896654 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:38.993933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:38.993897 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:42.080034 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:42.080002 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zkpwv_360feee3-2f22-467c-b806-d821d8065b6b/global-pull-secret-syncer/0.log" Jul 07 14:36:42.170992 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:42.170968 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" Jul 07 14:36:42.305213 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:42.305186 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-166.ec2.internal_d321df27ccbda0a9064af37cdfbcd85b/haproxy/0.log" Jul 07 14:36:45.125933 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:45.125900 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:45.192498 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:45.192431 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dtr9s_3b5a6a57-9345-499b-9d80-9da55bfa0a4c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:47.346836 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:47.346806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzrtb_03f12692-c80b-4ff6-89f4-1f5906e6e456/node-exporter/0.log" Jul 07 14:36:47.442758 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:47.442701 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzrtb_03f12692-c80b-4ff6-89f4-1f5906e6e456/kube-rbac-proxy/0.log" Jul 07 14:36:47.503069 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:47.503048 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzrtb_03f12692-c80b-4ff6-89f4-1f5906e6e456/init-textfile/0.log" Jul 07 14:36:50.262885 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.262855 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696"] Jul 07 14:36:50.263265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.263114 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" containerName="console" Jul 07 14:36:50.263265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.263126 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" containerName="console" Jul 07 14:36:50.263265 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.263173 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="964fd1cd-a51a-47fc-bfe6-1400d0c390d0" containerName="console" Jul 07 14:36:50.266296 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.266276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.270425 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.270405 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7x97\"/\"kube-root-ca.crt\"" Jul 07 14:36:50.270512 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.270432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z7x97\"/\"default-dockercfg-4m829\"" Jul 07 14:36:50.270868 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.270855 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7x97\"/\"openshift-service-ca.crt\"" Jul 07 14:36:50.284521 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.284502 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696"] Jul 07 14:36:50.294562 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.294516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-sys\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.294562 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.294591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-lib-modules\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.294762 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.294635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpsn\" (UniqueName: \"kubernetes.io/projected/6a979bd5-651d-4d14-a32b-b5c90c474b3e-kube-api-access-7wpsn\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.294762 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.294664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-proc\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.294762 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.294714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-podres\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395237 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpsn\" (UniqueName: \"kubernetes.io/projected/6a979bd5-651d-4d14-a32b-b5c90c474b3e-kube-api-access-7wpsn\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395415 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-proc\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395415 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-podres\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395415 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-sys\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395415 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-lib-modules\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395415 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-proc\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395656 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-sys\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395656 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-podres\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.395656 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.395494 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a979bd5-651d-4d14-a32b-b5c90c474b3e-lib-modules\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.409250 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.409227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpsn\" (UniqueName: \"kubernetes.io/projected/6a979bd5-651d-4d14-a32b-b5c90c474b3e-kube-api-access-7wpsn\") pod \"perf-node-gather-daemonset-ts696\" (UID: \"6a979bd5-651d-4d14-a32b-b5c90c474b3e\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.508660 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.508631 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-wmw5k_1102d5e7-d6e9-43e7-889e-6127f544fa65/networking-console-plugin/0.log" Jul 07 14:36:50.576645 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.576552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:50.704242 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:50.704220 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696"] Jul 07 14:36:50.706333 ip-10-0-130-166 kubenswrapper[2560]: W0707 14:36:50.706307 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a979bd5_651d_4d14_a32b_b5c90c474b3e.slice/crio-c07dbf88960a6a65248cdd63394b368eccfcf012ffac381fa8c87f15e6fcb27a WatchSource:0}: Error finding container c07dbf88960a6a65248cdd63394b368eccfcf012ffac381fa8c87f15e6fcb27a: Status 404 returned error can't find the container with id c07dbf88960a6a65248cdd63394b368eccfcf012ffac381fa8c87f15e6fcb27a Jul 07 14:36:51.236681 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:51.236646 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" event={"ID":"6a979bd5-651d-4d14-a32b-b5c90c474b3e","Type":"ContainerStarted","Data":"192796db94555b72d07605bb4e7940aa8bfcbf62fd8a558ac9bb6653ee7b0085"} Jul 07 14:36:51.236865 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:51.236702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" event={"ID":"6a979bd5-651d-4d14-a32b-b5c90c474b3e","Type":"ContainerStarted","Data":"c07dbf88960a6a65248cdd63394b368eccfcf012ffac381fa8c87f15e6fcb27a"} Jul 07 14:36:51.236865 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:51.236732 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:51.272394 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:51.272343 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" podStartSLOduration=1.272330305 podStartE2EDuration="1.272330305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:51.271633122 +0000 UTC m=+1625.769243023" watchObservedRunningTime="2026-07-07 14:36:51.272330305 +0000 UTC m=+1625.769940205" Jul 07 14:36:51.553045 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:51.552962 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668c9c757b-qjj2z_ee9d26fb-7fc1-4134-aaac-1dfab0d7b683/console/0.log" Jul 07 14:36:53.469617 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:53.469563 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtq62_12efb052-f435-486c-b580-fc65a24ac9a4/dns/0.log" Jul 07 14:36:53.504413 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:53.504365 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtq62_12efb052-f435-486c-b580-fc65a24ac9a4/kube-rbac-proxy/0.log" Jul 07 14:36:53.623531 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:53.623503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kt555_0951b37b-f843-421a-aace-547733f217a1/dns-node-resolver/0.log" Jul 07 14:36:54.289490 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:54.289457 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lddn5_05639699-cbac-42be-bd67-a297f0aba5e3/node-ca/0.log" Jul 07 14:36:55.906907 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:55.906878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s8thk_963a6b20-2e7d-4210-aa24-82f939e660f1/serve-healthcheck-canary/0.log" Jul 07 14:36:56.819588 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:56.819541 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh9z5_162038fe-c332-4579-8404-6ba4f983382a/kube-rbac-proxy/0.log" Jul 07 14:36:56.873511 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:56.873485 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh9z5_162038fe-c332-4579-8404-6ba4f983382a/exporter/0.log" Jul 07 14:36:56.929431 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:56.929406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh9z5_162038fe-c332-4579-8404-6ba4f983382a/extractor/0.log" Jul 07 14:36:57.252627 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:57.252603 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-ts696" Jul 07 14:36:59.253959 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:59.253925 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7598d7bb4-588f4_5427ba84-463d-46fb-ae0c-16f8aa8670fd/manager/0.log" Jul 07 14:36:59.432336 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:59.432300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-kp5n6_8dce1800-30b6-4200-8754-c9548f3053d4/manager/0.log" Jul 07 14:36:59.822737 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:59.822708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-8cbpv_c026212c-ebf4-4a90-8ee2-84796758bcdb/seaweedfs-tls-custom/0.log" Jul 07 14:36:59.893197 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:36:59.893172 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-tgfzd_178ec9f7-0a2c-4f97-b6c3-fc84688f03dd/seaweedfs-tls-serving/0.log" Jul 07 14:37:05.141856 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:05.141823 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-s2p47_ccde8dfa-a575-401e-945c-62ccc9045169/migrator/0.log" Jul 07 14:37:05.220407 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:05.220380 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-s2p47_ccde8dfa-a575-401e-945c-62ccc9045169/graceful-termination/0.log" Jul 07 14:37:06.753085 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:06.753054 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6pt5b_472b3a05-5073-4776-84a3-ab34a2a996f1/kube-multus/0.log" Jul 07 14:37:07.089291 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.089221 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/kube-multus-additional-cni-plugins/0.log" Jul 07 14:37:07.127482 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.127455 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/egress-router-binary-copy/0.log" Jul 07 14:37:07.160722 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.160702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/cni-plugins/0.log" Jul 07 14:37:07.193772 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.193754 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/bond-cni-plugin/0.log" Jul 07 14:37:07.226976 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.226953 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/routeoverride-cni/0.log" Jul 07 14:37:07.265506 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.265487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/whereabouts-cni-bincopy/0.log" Jul 07 14:37:07.301554 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.301531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9tw5l_a9401913-b94a-417e-b33d-61741c87fbe1/whereabouts-cni/0.log" Jul 07 14:37:07.769283 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.769255 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d7svr_02ff2b42-e953-4f80-baf7-0848eabfa44e/network-metrics-daemon/0.log" Jul 07 14:37:07.807173 ip-10-0-130-166 kubenswrapper[2560]: I0707 14:37:07.807128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d7svr_02ff2b42-e953-4f80-baf7-0848eabfa44e/kube-rbac-proxy/0.log"